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PREFACE 



The following document is the final technical report on the 
materials developed under contract number NE--G-00'-3'0075 
with the National Institute of Education by the Computer 
Technology Program of the Northwest Regional Educational 
Laboratory. The purpose of the report is to document the 
development and evaluation of t^e product contracted for: 
Data Management & Decision Making. ^ • 

This report is designedjp be of use to a variety of different ' 
audiences> tIi^ summary given at the beginning of the report 
provides information on the effectiveness of the Data Management ^ . 

Is ion Making materials for those interested in adopting 
them for instructional use. The^ body of the , report gives a 
detailed evaluation of Data Management & Decision Making 
and provides evider^ce of successful completion*, of the contract. 
This report is^not Intended to reach <l11 possible audiei^ces 
interested in these materials; this will be attempted by other 
means. 

^ .■ > 

A number of persods on the Computed Technology Staff were 
involved in the development and evaluation of Data Management 
&^ Decision Making . Stuart Speedie and Susan -Sanders were 
the primary developers of the materials. They were also 
responsible for conducting the formative and summative 
evaluations of the-^materials. Duane^ Richardson servet^ as 
project director and wjas responsible for ;the overall management 
of the project. Antoinette Ellis sezved as the editor for these 
materials and Nancy 'l^rgo performed all secretarial duties 

associated with the profect. . • , 

t ' 

:^,Particular gratitude must be extended to several persons outside 

the Laboratory w^ were helpful in completing the project. The 

help of Drs. Ralph vanDusseldorp and Francis Miles in 

iinplementing the fleld^ tests Is greatly appreciated. The reviews 

of brs. John Lind, James MacNamara, Donald Treffinger and 

Ralph VanDusseldorp were extremely helpful in revising the 

materials. ^ • - . ^ * 

• I 

Any questions regarding Data Management '& Decision Making ' 
should be' addressed to Dr. Duane Richardson, Computer Technoligy 
Program, Northwest Regional jEducatlojnal Laboratory- 
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THE MATERIALS IN SUMMARY- 

Description of the Materials * 

Data Magagement & Declsloa Making Is a set. of Instructional 
materials designed to teach^Rjracticlng and potential educational administrators 
about the uses of operations research In educational administration. It 
consists of five units: 

1. ''Operations Research In Education*' 

2. "PERT/CPM: A Planning and Analysis Toor- 

3. "Linear Programming" " * . 
4^ "Queuelng Theory" 

5. "Computer Simulation" 

The first of these units Is designed as an Introduction to the other/ 
four, and .Is intended to l?e an "organizer" for^ the other unlfs. Each of 
the units Introduces a specific operations research technique and providesj^* 
Instruction on the basic terminology and skills involved in the. techhlqqe. 
Each Ainlt gives the user practice In the procedures of the technique arid In 
using the computerized ver.slons^of the technlque^^ In e^ch case. Instruction 
. Is provided in using the computci* terminal. Inputting the data, and ^ 
Interpreting the output of the computer program.. Throughout each unit, 
exa&nples from the field of educ^ati^A^re used to Illustrate pbin^ and 
procedure's, a'nd the fina,l portion of eai^h unit dlsciisses how ^e technique 
can be used In solving problems In ejiucatlonal administration. The units 
are constructed so that the user is made aware of the Instructional • 
objectives of the unit before starting work on It and exercises are ' ' 



interspersed throughout the tests to give the use^r practice irf using thfe. 
concepts covere ^ . • 

■ ' As the titles of 'the units listed above indicate', the materials are 
concerned with four specific operations research techliiques beginning with • 
PERT, which is a technique for planning the "allocation of resources in 
large projects. The second is linear progrumming, which is a mathematical 
technique for optimizing such quantities ^as cost under conditions of 
cons*:ralnts. Queue tng thepry, the -third technique, is a mathematical 
methrd for analyzing situations in- w»hich a queue or line of customers 
must wait for some service^ The final technique,, computer simulation, 
' ^ 2L much more general problem s6lvir.g^ method. It is the process of 



using the computer t 
expensive, or. would 



o investigate situations in^whicb it is too dangerous,. 

•« 

take 'too long to e^qperiment with ihe actual situation. 
The two examples ttat are used as illustrations in the text are bus 
routing and enrollment prediction. 

Evaluation of the Materials " ■ » • ^ 

These materials were subjected to extensive testing and Yovlslon 

as a part of the developmental project. *Tlj!C first step in the development 

was to determine whether the goal of the niaterials was worthwhile and 

fulfilled a need. This was first attempted by reviewing the literature in 

ft 



educationkl admmistration. It was found lhat a number of experts in^* 
educational administration held that the operations* research techniques 
covered Ifi thfcs^c- materials could solve important problems in educational 
V administration and that training In these procedures was needed. Thifi ' 
provided justification for the inlti^al development of' the ^materials., * ; 



Further ^videace of need was sought"1)y implementing a needs 
assessment among the target populations-- students, administrators, 
and • professors of educational administration. This was' accomplished ^ 
/6y surx-eying samples from each of the three groups. A questionnaire' 
was designed, to elicit subjects' opinions about the impoi^nc6 of problems 
solved *by the four operations research teclinlques anc^helr perceived ^eed 
for training In these techniques. Subjects were coopejcating classes of 

^students. In educational administratiom, a random sample of chief school 

^' ^ . - \ ' ' ^ ^ ' 

district officers, and a random sample of the American Educatipnal 

Research Associations njembers the Admbilstratlon Division, The 

sample totalefJ-'^SO subjects*.. The outbome of this needs' assessment was 

• that in all three groups, approximately 50% of the respondents) indicated 

a high need for the' techniques and more than 70%N indicated that there wab- 
a need for th^ materials, thoug^ It may not -be pressing.... It was concluded 

. ' . ■ : ■ : y , \' 

• that tnSre was evidence of need in the general population of ^dminl^tx^ators 
and professors of educational administration, but thsit the conclus Ion \ could 
not be quite so strong among mdents since the sampling procedures, did 

•r^not permit it. , This survey provided farther justification foV the d[evelopment 

of the materials. ^ *• ^ * • . . " 

. \ i - ■ \ . ^ ' 

. ^fter iha initial development of the materials, they were subjected to 

two rounds of formal evaluation. In the first, the pilot testing the materials 

were tried oiit in college claases.' The sample consisted of 82 students who 

were both regular students and practicing admiuis^r-ators. Each subject was- 

- / \ ' ) ' I 

* randomly assigned one of the technique iintts and Avas given a pretest over 
♦ . ^ • \ * ' fc 

. • 3 



the unit's cognitive and affective objects. The unit was then studied for 
approximately sbc to ei^t hours. Each student then took* a posttest over 
the miiteriar^ objectives. At the conclusion of the testing, a random 
sample of students were interviewed about the materials. The results 
indicated three outcomes; ^ 

1. . In each case the unit caused s^ificant learning with respect, 
to tbti objectives of instruction. 

.2. In. each case, the unit was associated with positive changes 
» . . in attitudes towards operations research in education. 

3". In each case, the students reported that they found the 
materials to be motivating and relevant. 

After completion" of the pLaol test it was determined that Data 
Management & Decision Making (DM/DM) was sufficiently developed for 
a summatlve evalua.tfon by. ^he 'developers (a possible source of bias). 
The summatlve evaluation of the materials was concerned with several 
issues. First, could It be confirmed that the materials caused significant 
learning, for both the cognitive and affective objectives? Second, how 
does this learning compare with that caused ;by likely competitots of the ^ 

DM/DM materials? Third, what were the side' jeffects of using the DM/DM 

- ' * * \" * * ' 

•materials and how do they compare to those of the competitors? And' 

I '. ^ ' ' , ■■ 

fourth, what were the costs and benefits of using the DM/DM materials 

* * 

and how do these compare with those of their competitors? 



1 - The first part of the' summatlve evaluation was a field test of the 

'materials qig^iLnst their competitors. The sample for this field test / 
consisted of 102 college students d^rawn frcv^s iaeses In^ 

educational administration at two dlfferettft » '1^ vVlth certain 

* * ■ ■ * ' 

(exceptions, each^student was randomly a'sslgned two units, to study — a 

I. i : '■ ' • ■ . . ■ • ■ 

IdM/DM imit and one of the competitor units which did not correspond • 
to the DM/DM unit. /In two cases only one unit was assigned. Eac^i \ , 
student took pi^'etests over the two units assigned to him ^nd then posttests 
after finishing the materials. Generally two class sessions were allowed ; 
for the experiment, but some classes used three sessions." At the 
termination of the last session., students also filled o;at a questionnaire 
giving ^eir reactions to the materials. ^ ' 

• ;a ii • 

• * There were two major results of ' this field/ test/ First, .the 



significant learning caused by each of the DM/DM units in the pilot test 
was confirmed for the.'cognitive\objectives. In no c£se was an average 
of less than 60% of the inktructional objectives achieved for a unit, apd 
this was always a significant gain over performance on the pretest. 'With 
respect to attitude change, no information was obtained from the field test. 
However, using inforniation previously obtained, ll was determined that 
the materials did not cauoc «ny overall significant positive change In 
'attitude toward operations research. Yet, it' js important to note that the 
attitude instrument indicated , that these attitudes were quite positive before 

^ 

the students started the units. , 
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WltB*EBspect to the competitors, the results were mixed, -though 
in no case did the DM /DM materials do '^yo^se than the, competitors. In 
several cases the DM/DM materials weue associated with significantly - . 
better performance than their competitors — PERT/CPM, Li near Programming, 
and C ompu te i^;;^S Imula t Ion . But these resttilts cin|lfeiwSed ou whether or not 
the unit and Its (competitor were compared on*the full set of cognitive ^sfc . 
items or orfly those test Items which. the two units had In common. 'There 

was rto con^lstjeiit pattern. This, the conclusion was that the DM/DM 

/ ■ . 

I 

/ \ ■ • 

materials ^do cause learning, and they sometimes do better, and never 

worse, {ban their llicely competitors' In the educational marketplace. 

The second area of concern In the field test was side. effects of the 

materials, where side effects were considered to be unexpected outcomes 

i ■ ■ ' . . \ \ . ■ ■ 

of the materials, lliis data was obtained by Interviewing the principal 

instnfctors and analyzing the responses of the students to a questionnaire. 

Due to the -nature of the data collection, on}f Information on short-term . 

i - _ ■ 

side effects was obtained. The results of thiii? Investigation indicated that 

the prlman* side effects of the DM/DM materials had to do with the 

computer. Students reported and instructors observed that students learned 

to* use the 'cornputer as ^a problem solvuJg tool, they gained confidence In , 



using lt,!!f they Wanted to participate/ In additional use, of the computer, but 
they became some\vhat frustrated /when first using the terminal. Positive 
*. ^de effects of the materials themselves were that .a majority of all users 
would recommend the materials to others and that students wanted to leg.rn 
more about operations research in education. However, a sense of. ? 



frustration with the i^^tterials Was expressed by almost all students. The" 
side effects report^*^ f^^ competitors were eSj^entlally similar to- thpse 
reported for the.Djyi/ijJVI materials except they were smaller In number 
and there were not associated with the computer. It was conclu^^^ • 
that the. PM/DM xxi^t^H^^^ have mom side effects than their competitors 
and that these side ^ff^^ts ar^ ..a. os^ve' and had to do; with the 

computer. " . ^ 

'the final pj^a^e summative evaluation dealt with the costs 

'and benefits of usi^g ti^e DM/E^M materials ^d how these compared with , 



those of its competi^tQ^jrs/ Costs such as cost of the materials, computer 

uSage^ Instruclorg, ^^d idst personnel time were identified as the paajor 

cost sources; howe^^iTf the total costs of using either set of materials Is 

hi^Iy variable bas^^ c^fn bow the;.'materlals, a*e used. Thus, the costs of 

" using the DM/DM ^^^^t^^^^^ ranged from $41 in the least expensive 

condition of self ^t^^y to $3,500' foi'.a most expensive condition of a four 

day workshop for administrators. .Costs for using the ^mpetltors In ^ 
\. , " ' ■ . 

the ^ame condition^ W^^e couiparable, ranging from $45 to $3^400. 
'-"^ , » , 

The -beneftt^ ^{ the materials were considered to be the objectives 

\ ^ ' . . 

Ithat they met and t^^ ^We effects they demonstrated.- Thus,* the i?rimary 

benefits of the D]Vi/I)]Vt mater l^s are the knowledge and skUls iiiiparted by 
. the materials as. d^^cr^^ed above. The benefl.ts of the competitors are*^ | 

essentially the sa^e^ excluding those objectives dealing with us^ng the 
.computer as a pro^^^l^ solvLpg tool. As stated previously, the side effects 

of the DM/DM mat^^l^s were also associated wlt>h the computer,* while the 



side effects of their competitors were negligible. The DM/DM materials 
appeartXto have more benefits' of use than did theii* competitors. / Thus 
the conclusion of the cost and benefits study was that for about^the same 
costs^s its competitors the DM/DM materials provide more benefits for 
the user in terms of knowledge about, confidence in using, and awareness 
of the usefulness of the"^ computer as a problem solving tdbi'ln edi cational 
administration;, li '-ion to ?^sfully' impartinf^ knowlr^^a) of operations 

researcji techniques. ^ ' 

The summative conclusion of this technica^ report is that Data 
Management & Decision Making^ is a validated product with respect to its 
. u§e as instructional materials in college courses in educational admin istrat?ion 
This was concluded for the following reasons. First, there is empirical 
evidence of need for these materials. Second, using the DM/DM materfafs 
causes significant increases in learning, with students achieving more than 
60% of the instructional objictiyes on any one imit after six to eight hours 
of study under conditions ..not designed to promote maximum learning. 
Third, the use of the DM/DM materials was assooLated with a number of \ 

positive side effects with regards to computers. Fourth, in comparison with 

^ . . ■ ■ 

its possible competitors, the DM/DM materials caused significantly more 

■ ■ / ■ 

learning for three of the four\ techniques units, and in no chse did they - 
"perform any worse; they had more positive .side effects than^^4^ their 

■ ■ • . . r ■' 

competitors; and they were mote cost-effective. It was thus concluded 

■ * ^ ■ 

^that Data Mafiagement arid Decision Makin g is a .-validated product which 
meets an established need and is therefore a worth\Yhile prod^t. In 



additidji, because of^ts comparison with coinpetitors.it was conclucjed that 
it also. has relatively more worth in the educatiqpal marketplace than its 
competitors. ^ . ' 



er|c 
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THE DEVELOPMENT OF DATA MANAGEMENT DECISION MAKING 

The Developer ■ ^ ■ - 

Data Management & Decision Making was developed and tested by 

the Computer Technology' Program of the Northwest Regional Educational 

♦Laboratory, This set of instructional materials was developed in 

accordance with the mission of the Computer Technology Program which 

is stated .in part In their Basic Programs of 1972* as: ^ 

Objective; The objective /is to create a system of models, 
materials and procedures Jhat will fac 11 

use of computer technology to effect educational renjewaL ^ 
^ - Strategy; . The progarlam Is product oriented, ^^fS>^^ primarily , 

toward the development of; (1) materials forme education of 
educational personnel and (2) curtlcular materials and 
\ administrative applications ,for their use. They are designed 

• to provide: « (1> school ^mlnlstrators the opportunity to / 

become competent in rdeslgnlng, evaluating and implementing 
admiriistratlve uses of coinjputer technology/ (2) teachers the^ 
' opportunity to become competent In designing, evaluating and! 
, implementing lnstructional?^ses of:.computer technology and 
♦jv^ (3) students the opportunity to- become more knowledgeable 
about computers and '"^ga in career capabQlties In computer 
, related occupations. Expected Outcomes; Once the total, 
^integrated system of products is available', a significant^ increase 
is foreseen In the availability of preservice and Inservice 
training for- educators. An extensive library of computer or.iented 
curricular mater ials^^ will^be available in a wide range of 
^ secondary subjects. The number and quality of courses 

relating to the social Timpllb at Ions of computer technology will 
increase^ Ultimately, this will facilitate education which is 
relevant, practical, humane and appropriate for the. individual. 
- needs of students.^ ' • / . 

' ■ ' \ ' . ' ^ ' 

The personnel training ^component of t^is .mission provides ''for 

the development of instructional products for administrators. It states 

in part that / ^ ' v, *" • 

1 Computer Technology Program^ Basic Program' Plans, ^April 1972, 
p, iiL 



Objective; * The obie^ctive is to provide educators the opportunity 
for training both in T:sing available computer applications' and In 
active^ part ic .ijabiii^ In decisions which shape technology for 
^education and the implementation of that technology. Strategy; ^ 
Three types of personnel training systems are planned. (1) Four \ 
coursesj for administrators include an Introduction to computers, \ 
• , administrative applications, data management and declsi^on malting, 
and Implementing computer systems, (2)^ Three course's for' teachers 
incmde an Introduction to computers, sxibject matter applications, 
andAselectlon of instructional materials, (3) A course for 
develoj)ers of computer Instructional materials provides relevant 
for teachers, wrlEers, subject area specialists and rson? 
* Involved in computer related activities. Expected Qutconyes; 
Preseryice and inservice training utilizing Lab or at o:^ systems 
^ win Increase the ioioMedge ci achool personnel about computers, 
their skill la' using applications of computer techrto logy, for 
instruction and administrative tasks, and abilities^ to deyelop conq.puter 
based materials.^ - 7 \ ^ . 

■' ■ ■ ' ■ \ 

One particular product of the personnel training component '^as 
Data Itianagement & Decision Making (DM/DM). The overall goals or these' 
materials were specified as the Instillment of an awareness of and some 
familiarity with specific operations research techniques in educational 
administratars and creation. of a positive attitude toward using operations 
research in' educational administration. The tecnniques were Identified as 

Program Evaluation^ and Eeview* Technique (PERT), linear programming, 

> . c . - ^ ■ ^ 

queue ing theory and cpmputer simulation. 

The target groups were determined to be persons who were . 
significantly involved In ^educational a\jminlstratlon. They were divided' 
into primary and secondary target pop\^lations. ^ The primary target 
populations were identified as students in educational adminlstrati^on and ' 
practicing /educational administrators returning to school for continuing *. " 

.. education. It was expected Ihht these target gproupSc woiold accomplish'the » 
general goal of the materials by using Data Management & Decision Making 
as part of a cpUege or university ^course In educational: acjministrat ion. 

1 Computer Technjlogy Program, Basic ^^ogram Plans, April 1972, p^iv. ' 



Two secondary target groups were also identified. These gr6ups 

were considered secondaiy targets ^n the s'ense' that it was not intended' 

• fhat they should accomplish the goals of the materials fay directly using 

them. Rather, they were to be persons who were Interested in using the 

DM/DM materials as an Instructional tool/ It wa^i assumed tbat li <>vo 

groups uith this interest would be professors of educational administration 

and persons responsible for conducting administrator Inservlce workshops. • 

It appears that these groups overlap considerably, and thus for the purposes 

/ ' . . - ., • 

1 , ft * 
of this technical report these two groups are considered one, 

Prelbulnary Evidence of Need • . . 

After the general goals of the product were developed,, it was ^ 
' . . ' ' < 

necessary to determine If there was an apparent need for the product as 

« . • * " 

deflnjBd by its general goals. The .method ^by which this was accomplished 

was a review of the relevant literature In educratlon. It was assumed ^ 

that this literature was written by experts' in education In general and 

specifically by experts In educational administration. The following " 

reasoning was used to determine evidence of need from the literature. 

If experts claim that operations research techniques can produce .needed 

solutions, then there is the possibility^ that there exists a' need In * 

educational administration for kqowledge of these techniques. \lso, if 

there Is the possibility that a need exists for knowledge of thei e operations 

research techniques, then' there is^&e possibility tha/t. t^^aining materials 



. ■ / 

in these techniques are nteeded. - If this Is the case, then there is some ' 
justification for the development of these techniques. 

20 . , 



The following review of the literature Is divided Into five sections. 
The first deals with the need for operations research in general, and the ' 
other four d^al with the* need for specific fecliniques. \ v 

. ^ ' Operations Research In n eral • 

■ . •• " " " , / 

' A nun: ^er of authors have Indicated ihat therejis a need In educational ^ 
administration for operations research techniques. Hlrs|i et al" (1967) ^ 
Inventing Education for the Future stated that education n^eeds to change to keep pace 



with the rest of society and jhat operations researcH ia planning and.forecasting.are 
one of several Innovations which can effect these changes. Slsson (1.967) indicated 
that 'operations research techniques are potentially useful for study of large 
urban school district problems" such as administrative decision making and 
board policy functions. Cook (1968) also stated that" operations research 
would ^be .useful for solving "problems in educational, project management and 
administrative decision making. ' IVTcNamara (1972) strongly implied.. that 
operations research can be successfully utilized In educational organizations 
to effect needed ^changes and program improvements, Bruno and Fox (1973) 
asserted that quantitative methods can ^greatly assist the school administrator . 
in certain decision making processes; that there is an Increasing demand 
for administrators trained this'\vay; and that training materials in such 
quantitative techniques as those In operations research were needed. t 
VanDusseldorp, RLchardsoa and Foley (197J) demonstrated that operations 
-research ^techniques can be used to solve a number of types of problems, 
in educational administration- . Alkin and Bruno (1970) claimed that systems 
approaches are[\iseful for solving both mico-problems such as school 



business functions and lu oblems. Operations p.sf rch woi i 

be useful. The preaomlnani uuii expressed by these authors 
appears to be tKat operations research techniques can be very useful * 
in education and that knowledge of these techniques Is Important for 
educational administrators. > . 

Planning, Evaluation and Review Technique 

<~. . , ■ ■ 

-* t ' ' •, 

A number of abthors provided evidence that there is aS^eed for 

PERT. Cook (1966, 1967), perhaps one of the foremost proponeV^ ^^^i 
PERT in education, ^serts that an important problem in educatlona^ 
planning is the allocation of time and manpower for specific projects, 
and PERT ig a technique .which facilitates this type of planning. 
•Cochran (1969) Indicated . that planning is an Important part of decision 
making and that PERT has great utility in planning. Knezevlch (1969) 
Stated that new approaches to decision making and problem" salving / 
In educational a*dminlstration are needed; that systems analysis /r 
affords promising approaches, and that administrators would benefit from 
implementing si^ch a rational approach as PERT^ Maler (197(J) Asserted 
that PERT is a basic procedure for project /Management In educatioh. 
Kaufman (197C) agreed. Alkin and Bruno (1970) maintained, that PERT 
and the Critical Path Method have much to offer the hnplementorj m 
managing and controlling educational systems^^ Einallyi. VanDusseldorp 
^ et ^1. (1971) stated that '^The use of PERT to allocate and manage time 
involved in the various activities comprising a project have proven v^ry 
useful in education.^' Thus it . Is possible to conclude that experts 



conslde.' .''EUT to be an important tool for educaiioaaradminlstrators. 

Linear Programming 

The i;ieed4or linear programming was also expressed in terms of Its use- . 
fulness to the educational administrator, Correa (1966) demonstrated that linear 
programming can be used to help solve the problem of whether we should have 
more or better schools. MacNamara (197-1, 1973) examined recent developments 
In linear programming and demonstrated h« ^"^^ould'be applied to problem solvlhg 
at the state and lo'c^ level. Alkln and Bruno (1970) asserted that there existed a 
large class of assignment and distribution problems in education, ^such as 
allol>atlng classrooms and facilities, which linear programming Is especlallj^ 
suttee} to solve. Finally, VanDusseldorp et aL (1971) claimed that linear . 
prpgramming is useful for solving educational problems in which resources 
.are allocated or are assigned so that the oufoome Is/ optimal,, and thus' It j 
. can.be a powerfuh tool fpr educational prdblem solving and decision making. 

From this it may be -concluded thkt^: these experts viewed linear >progS'amming 
^^;as applicable to. educational problems. ^ f . - 

' , Queue ing The^ory ' ■ - ^ 

Two authors have indicated that there is s. need for quetieing 
theorjr. Alkth and Bruno (1970) . state that "By applying the queueing 
theory techniques^ to the business-like, activitt^ of education, 'those 

activities could tie greatly systematized." And VanDus se Id o rp ' et- al - ^ J 

"1 * * k ■■ ..'..* 

(1971) indicated that waiting lines are common in education whenever '■ 

'. . " ' . ' . . --^ 

fackities are shared by ..a number of persons and that ^queueing theory is . 

'. , > . . ' ^ 

.applicable 'in making utilization of facilities 'more efficient. Thiis there.:, 

is some evidence of the usefuli^ess^aLJiueueihg. theory. 



Computer Slmulatlpn ' . 

As was the case with queue ing theoryV the need for computer 

•» . ^ ■ 

simulation In educational administration was implied by two authors. * ^ 

Wilson (1969) asserted that there was a need to establish, goals, ^ 

•guidelines and constraints In educac^orial planning and furthe^ore 

that there was a need to stud^ large and complex educational systems. He 
concluded by stating that' computer simulation can provide a powerful tool'^for 
\mee ting these needs. Alkln and Bruno (1970) maintained that there Is a need 
tb examine and understand educational systems Interactions and that this , Is 

\ ; ■. •. 

fed^ible by means of a modelrwhere the moSel reflects the complexity of . 

the*Vystem. They conclude that computer simulation can provide such 

\ y . .' •- 

model;3. Consequently, there is some evidence In the literature that 

I 

compufer simulation could be a useful tool In educational, administration. ' 

\ .', ■ ■ ■- • ■ 

\ . . Conclusion , • • 

■ \ — : — ~~ . 

* . * 

Frtom the literature cited above. It Islfeosslble to conclude that 
there WistV evldenpe In the literature of education* that operations research 

V . . ' \ ■ • : ' • ■ ■ ■ 

and Its techVlques, such as 'PERT, linear programming, queuelng theory, 
and computet^ simulat4on, can be used to solve important educational 

,\ ■ \ * c ' ■ ■ .. 

■' •■ . » ■ ■ . 

problems. ^.Fuithermor.el ^ number of sources (Alkln and Bruno, 1970;^ 
Bruno and Fox, 1973; Va^Dusseldorp et al. , 1971; Hlrsh, et al. , 1967; 
Knezevlch,*- 1969; McNajiiara, 1972; Slsson, 1967) Indicate that these tools 



ar^e not widely us^d. /Therefore, "it Is possible to conclude that training * 
materials, which are concerned with these operation research -techniques are 



ne^dad and thus .that ttfere is justification for developing the Data Management 
' & Decision Making materials in line with the stated goals. 



In Jthis section the Instructional materials that were developed out \ 
of the generalized goals' for DM/DM wlU be described. The purpose of/ 
this sectl^J^ to inform the reader of the nature of the DM/DM materials 
with rjsspeck to 'instructional objectives, spjecLflc content |^n^ structure. In 
the„ fallowing sections each of the units will be described. 

Operations Res^earch In Education 

This unit Is intencfSd as the Introduction to operations r-esearoh and was . • 

constructed to serve as an "advanced organizer*/ (Ausubel and Robinson, 1969) in 
' ■ ■ * ■ fc 

that it should organize the' thinking style of the users so as to be more readily - 
adaptable to' the rest of the materials. Since .this Is the case, specific instructional 
objectives were specified for the unit, bj^t It was considered of little 

importance whether or not the Individual user actually achieved them. , 

* ■ 1 * ■ . • 

- The unit discusses th^decision procees in general ttftms- and analyzes 
this process into three majtfp'^components — the decision 'context, decision 
Strategies, and the payoff. .These components ar^atdlscussed in some -detail. 
This unit also introduces the four specific dec isipn strategies or operations 
re'search techniques which are treated in the other fofur, units/ These are ' 

■ \ ■ • ■ ■ ■ ' " ■• ^- ■ ■■ ^ ' ' 

PEPT/CPM, llnea'r programming, queueing theory, and computer simulation. 
The purposes and apjplications of each of these techniques are ^>rlefly • 
described and ar.e intended to serve as organizers for the -four 6aier units 



The booklet conqjudes with a summary of th^main points ' and a listing of % 

* . ■ \a 
tb^ instructional objectives. These Instructional objectives may be found 

*in Appendbc A. The present' form of this unit -is a paperbound booklet, of ^ 



20-pag2S printed on both sides, with intervening illustrations and exercises^ 

These exercises are Interspersed throu^ the unit -for purposes of providing 

the student with practice in the concepts under disa\ssiori, ' After -completing 

» 

. . ■■ - •> " , 

this unit, the student *is free to proceed to any or all of bhe remaining four 

units. . . 

'* . . . - -■• 

This unit provide.^ an"' introduction to PERT for the^'educational 

administrator. , The teciinique is lyiethod for planning the allocation ^ • 

- . I 

of resources in the.exet ition of projects. jTh^ version of PERT covered 

^ j ^ 

in this unit Is concerned with several tasks in jtl|e planning process: 

1, Identifying the specific activities in a:project . 

2. Determining their interrelations ' 

• . 3, Mappirg tI\esS^elations in network form 

4. Assigning estimated time durations for each of the 

» f 

* gictivitles . . 

5. Determining various timing characterlsitics of the project; " 
including the key sequences of events for completing: the pi^ect 
on schedule, called the Critical-Patlx Method (CPlJI)-. . 

.This content serves as the basis for the instructional goals of ^hp unit. 

The unit first discusfses the applications of PERT/CPM in general 

. ^ » ■ ' ■ ■ • - 

with pa-rticular "References to application^ in educational administration. 
The unit then goes on to introduce the user to the steps in executing a 
PERT/CPM analysis including identifying the activities, "constructing a . 
PERT/CPM network, cofhputlng project times, and finding the critical path. 



After the user has learned to execute a PERT/CPM analysis by hand, he 

Is - introduced to a computer program which carries out these analyses. 

Th^s program is GCPATH, which is presently implemented on a Hewlett- 

Packard 200£)F time-sharing computer, and is written in the BASIC 

language with the intent of bfeing transportable to a variety of BASIC 

systems. The user is lead throu^ a step-by-step process of using the 

computer program and is provided with a variety of exercises to practice 

his or her skill. Next the user is taken through a section which discusses 

other uses of PERT/CPM and the advantages and "disadvantages of using 

PERT/CPM in an" educational setting. .,The unit^ concludes with a summary 

of the topic and a. list of the instructional objectives for the^lt- (These 

objectives may be found in Appendix A.) The unit presently takes the-^orm. 

of a 68-page booklet with illustrations and interspersed exercises. The 

answers to the exercises are included at the end of the booklet'. This unit 

may be used alone, being dependent on only the Introductory unit, or In 

conjunction with any of th6 other three technigue units. | 

Linear Programming 

: This unit deals with applications of tihe mathematical' technlqu^es of linear 

programming In educational administration. Linear programming is a mathematical 

process for determining a set of conditions under which a specific quantity may be 

optimized.. The technique assumes that all conditions in the. problem aituatlori can 

be expressed as matherr^tlcal equations or constraints, that the basic components 

of th system under consideration are quantifiable, and that the quantity which Is 

to be optimized Is expressable as a functloii of the basic quantities. The 



technique will take these mathematical expressions and find the values of 
the basic' components Such that the quantity of cont^.rn (e.g.,. cost) is • 
optimized (either maximized or minimized). This forms the content from 
which the instructional objectives for this unit are derived. 

Ill IntroducliTg the educational administrator to the operations research 
technique of Linear programming, the unit first leads the user through a 
detailed but conceptually sbuple example of a problem solved' by linear 
programming. (s^Slnce t^e mathematical procedures for- solving linear 
programming problems are quite sophisticated and complex, and since the 
purpose of the unlt is to Introduce the administrator to the techhlque rather ' 
than make him an expert on the subject, no attempt is made to teach the 
user any of the applicable mathematical manipulations. Rather, the user 
Is provided with a computer program ^ use In solving linear progranmalng 
problems. This program Is called LDSTPRG and Is presently operational pn^ a 
Hewlett-Packard .2000 F computer and Is written in ^ the BASIC language with , 
the Intent qf, being transportable to a variety of BASIC systems. • In teaching 
the user to employ the program, he Is lead through a step-by-step process 
of entering the necessary Information on a computer terminal. Then the unit 
.goes back to a more generaL.dlscusslon of the procedures for 'formulating 
linear programming problems. The text then describe^ in. detail several . 
applications of linear programming In education such as planning low-cost 
school lunches and determining a salary schedule. . In the process of going " 
through this section, the 'user Is confronted with a number of opportunities- 
to use the computer program to solve a variety of problems. In the final 

" •20 
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part, the advantages and disadvantages of using linear prograniining In 
educational settings are discussed. The unit concludes with a summary 
of the main points of the unit and a listing of t? <5 instructional objectives. 
These objectives may be found In Appendix A, The unit presently takes 
the form of a i24-page booklet with illustrations and interspersed exercises. 
The answers to theg exercises are included at the end of the booklet. This 
'unit may be used with the introductory unit alone or in conjunction witl^ any 
of the other three specific techniques. ' . - 

Queuejng JTheory / * ^ 

This unit Is concerned with the application of the mathematical" 
techniques of queue Ing^ theory to educational administration. This technique 
provides several mathematical models of situations In which queues form. 

/ 

in education It Is applicable to/sltuatlons In which some customers are 
waiting to use a servljje "where the customer arid the services may be a 
great number of different things. Queue Ing theory will yield a number of 
quantities which describe this situation such as what the average time a 
customer must wait for service, how much of the time the service Is ^ 
Idle and what Is the probability that there will be a given number of 
customers waiting In '/'kij. All these characteristics of the queuelng system 
can tHeri be used to make decisions about changing the components of the 
queuelng system,' This mathematical technique forms She basis from which 
the instructional objectives for this unit were' derived. 



The unit , begins with an. explanation of the terminology of queueing 
theorj" and the conditions necessary for It be be employed accurately. The 
unit then presents four sets of conditions under which queueing theory may 
be applied and gives examples of problems which illustrate these conditions. 
In the process of presenting these problems, the user is introduced to a 
computer program which wilt- solve queueing theory problems. This program 
is called QpEUE and is implemented on a' Hewlett-Packard -20QP F computer. 
This program is written in BASIC so that^it can be transported to a variety 
of BASIC systems. In teaching the user to use the QUEUE program, the unit 
provides a step-by-step process of entering the necessary information on a 
computer terminal. This program is used throughout the test to solve 
queueing theory problems. The final part ot the unit presents the advantages 
and disadvantages of using queueing theory in educational settings, summariz'^^s 
.the main points of the unit, and gives the instructio^al objectives for the xmit 
This unit is presently 89 pages with illustrations and exercises Interspersed 
throughout the test. The answers to the exercises are included at the end 

of the booklet. This unit may be used with the introductory unit alone, or in / 

« \ ' ■ ■ j 

conjunction with juiy or all of the other three mnits. | 

Con i pater Slrnulatioa ' 'l' 

The .unit on computer simulation is concerjied with familiarizing the j. 

educational administrator with simulation as a problem-solving technique. j 

In this case, using a simulation involves Identifying a model of the system | 

of interest. This model Is then computerized^ and the behavior of tlje I 

system is investigated by experimenting with the coniputerized model. /' 

I 

. 30 .. ■ ' ! 



• The unit begins with a' theoretical treatment of simulation. It 
details the components of a simulation, th^ielasses^and tjrpes of simulation, 
and the purposes of simulation. This general treatment is followed by two 
specific educational applications of computer simulations. The first involves 
a computer program called BUSRUT which simulates the routing of school 
buses. The second is a computer program named ENRPRO which simulates 
the changes in a school district's student population over a period of years. 
Both of these programs are implemented on a Hewlett-Packard^ 2000 F computer 
and are written in ^he BASIC language for maximum versatility. In the case 
of each simulation, 'the student is lead througji a detailed, step-by-step 
procedure for using the simulation and Interpreting the output, and then Is 
confronted with a series* of problems which can be solved by using the 
simulation. The final portion of this unit is an overview of computer simulation. 
It discusses the advantages and disadvantages of using simulation In educational 
settings, summarizes the main points of the unit and lists the instructional 
objectives for the milt. This unit presently takes the form of a 101-page / 
booklet with Illustrations, computer printouts, and Interspersed exercises. 
The answers to the exercises* are included at the elid of the booklet. Lllve 
the other technique units, this unit may be .used with only the Introductory^ 
unit or In conjunction with any or all of the other tliree units. 
Intended Uses for the Materials . - , / 

Data Management & Decision Making Is designed to be used In any 
of three Instructional situations: • ' 

1. College level courses In educational- administration 



2. Inservice or normal training workshops 

3. Independent study in operations research. , : 
Each of these three uses of the DM/DM materials requires 'different 
conditions. ♦ . - 

4 

When the DM/DM' materials are us£;d in a college course in educational 
. administration, they are intended to. serve as a .supplerneht to the usual 
course content. Consequently, it is possible to use anything from a jingle 
unit to all of the units, depending upon how much time the instructor wishes 
to devote to operations research* Due to the structure of the units, it is 

■ . : ■ ■ • - I 

not necessary for the. instructor to IjBctuye \on the techniques'he or she wishes 
to cover, but the learning process will .be facilitated by having the instructor 
^(railable to 'answer questions and conduct group discussions concerning the 
topics under consideration. Optimal use of these materials requires having, 
access to a time-sharing computer and several computer terminals. Some 
evidence indicates that it is also facilitative for "students to work on tKe 
materials in smal^ groups, as it is conducive to problem solving. In addition, 
the testing of the materials indicated that a minimum of two class sessions 
should be devoted to each unit, since approximately six to ei^t hours are 
necessary to go through Qach of the units. With arrangements such as those 
stated above, it should be possible, to obtain results' as good as those obtained 
in the field test, and with the additional participation of the Instructor, It is 
anticipated ihgit-the results of instruction should be even more positive. 

4 . . v 
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When the DM/DM materials are. used in inser\ace training or 
a workshop, a large variety of instructional conTiguratlons. are possible. 



( The three most^ probable configurations wiU be discussed here. The first 

*is ia one-day inservice training session for practicing administrators. Here 
It will probably be most appropriate to concentrate on only onevtechnlque, 
• ^ince about six to eight hours will be required. Again, computer access 
must be arranged for and terminals must be available. It Is also assumed 
in this situation that the presence and participation of .the instructor Is 
particularly important. The most successftJl use of the materials In this 
^ . situation would probably be a combination of lecture, discussion, group work 
and self-study. These same cautions and conditions will also be true, of short 
duration workshops of a day or two. The second "alternative is theUong- 
duration workshop in which the entire set of DM/DM materials is used. 
This will be a period of concentrated stucfy in which each of the four 
techniques would occupy one day. of study. Again leadership will be 

^ . 'important ^to the success, of the workshop, even though the materials are 

designed to be largely self-instruJtionaL 

The third method of use pf the DM/DM materials Is' in the self-study 

mode. The materials were designed so that individuals Interested In usiog 

operations research in education could learn the use of some techniques by 

worlcing through the booklets; however ,"^lh this mode additional assumptions* '\ 

are made about the user. " La using some of the units, the mathematics is \ 

. . ^ ■ , : -A.. 

, mode^i-ately complex, arid so an individual; to be entirely Independent, must have\ 

a good background in mathematics. Also, in order to effectively use the 
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computer as a learning tool he or she inust.be somewhat familiar with 

the opei*ation of a computer terminal and have some knowledge of what 

to do to correct mistakes. In addition, in this mode it is espBCially 

important to work through the exercises, because the user has no other , 

source of feedback. ^ 

In summary, this section has described in detail the content and 
structure of Data Management & Decision Making. In addition, it has 
also described the three modes of instruction for which the materials are 
intended. This completes the description of the materials. 

Developmental History ^ " ^ ^ ^ 

The Data Management & Decision Making materials passrd through 
seveifal stages of development and evaluation before the product which Is 
described in this report was produced. The, developmental process had 
three formal ,stages. Associated with these developmental stages were 
two. formative evaluations of the products. The first development stage 
was the Exploratory Product which was subjected to Exploratory Testing. 
Based on this evaluation, the Prototype Product .was developed a id this, in ^ 
turn, was subjected to Pilot Testing. Out of this Pilot Testing, the Interim 
Pi^oduct was developed/ and this \yas the subject of the final investigation 
presented in this report. 

In the development of the Exploratory Product, a number of steps 
were carried out. First, the instructional goals were developed for each 
of the. units based' on the overall goal of the. materials. Each ui It was then 
outlined, and suitable computer prpgrams to accqmpany each unil were searched 

. 26 ' 
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out. As the last step In this initial development, the first version of eac^ 
unit was drafted. . . 

At this point the Exploratory Testing of the materials took place. This 
involved two activities — expert review *and individual trials. • In the expert' 
review, five authorities were selected to review the Tirist draft of the 
materials. These individuals weffe: 

\. Dr. John Lind, Professor of Educational AdmiHistratlpn, - 
Portland State University 

2. Dr. Charles Klein, Professor of Educational Administration, 
Purdue Uni versify ^ ^ 

3. Dr. James MacNamara, Professor of Educational Administration 
specializing Ln Operations Research,' Univei^ity of Texas 

4. Dr. Donald TrefTinger,, Professor of Educational Psychology 
and specialist in curriculum design. University of Kansas 

5. Dr. Ralph VanDusseldorp, Professor of Educational Administration, 
and specialist in Operations Research, University of Iowa, 

Each of these persons was sent a copy of the product along with a specific 
list of questions concerning the materials and was askedj^ carry out a 
detailed review^of the materials; Each performed the review and the 
developers received back the answers to their questions and the review 

t ■ . . 

copies with profuse marginal comments. • 

The other activity involved in the Exploratory Testing was individual 
trials. For tiie purposes of these trials, about 20 persons were randomly 



selected from a list of students in educational administration at Portland 



state University and asked to be paid volunteers. • Each of these volunteers 
was randomly assigned to one of the technique units making a total of five 
volunteers per iinit. A time was then set when the volunteer and the 
evaluator could meet. At this meeting, each volunteer was a^ked to work 
through the material In the presence of the evaluator and to comment on 
anything that caused difficulty or was worthy of comment. These sessions 
were also tape recorded. After all volunteers had gone through the materials, 
the materials were revised by the developers based on the outcomes of the 
trials and the validity of these changes was confirm^^d by going through the / 
same*process with two other individuals for each unit. 

The information derived from this Exploratory Testing became the 
basis for the revision of tb^ Exploratory Products to Prototype Products. 
The suggestions and comments of the experts were collected with the ' ' 

responses from the individual trials. These were then used to again revise 
the materials. These reviseo materials were then printed to produce the 
Prototype Version. 

This* Prototjrpe Version of the DM/DM materials was evaluated in an 
initial test. The initial testing of the Prototype Version is reported in"^ v 
detail in the document entitled Report on the Evaluation of the Protot3rpe 
Version of Data Management/Decision Making (Speedle, 1974). This formative 
evaluation of the materials will be summarized here. 

In this initial testing, the cooperation of classes of summer students 
was obtained at Portland State' University and Northern Arizona University. 
Two class sessions were used at Northern Arizona University and four class 



sessions were used at Portland State University. At the beginnii^ of 
the fifst class all students received ''Operations Research in Education'* and 
were randomly assigned to one of the four technique units. Before studying 
the units each student took a pretest over both cognitive 'and affective 
objectives of the units. They then worked through the units, reading the 
materials, performing the exercises, and using the computer. Then at 
the end of the last class session, the students tool? a posttest over the same 
objectives. Finally a randomly selected sample stratified by technique unit 
was interviewed by telephone concerning their reactions and opinions about 
the materials they studied. 

The results of this evaluation indicated a number of things. It was 
discovered that students needed a minimum of six to eight hours to work 
throu^ the materials. Apparently by studying the materials the students 
were able to achieve significantly more objectives on the posttest for each 
of the units. The units appeared to change some attitudes toward operations 
research in education and In the posiilve direction. Finally, the interviews 
indicated that the students were generally satisfied with the materials and 
thought them appropriate for educational administration students. • 

Since the results X)f the pilot test were so positive and no changes 
in the materials were indic^t^d as necessary, it was the decision of the 
project staff that the materials should "be advanced to Interim status and 
subjected to field testing. At the same time a summative evaluation of the 
materials was called for by the contract so that these two activities were 
combined. The 'summative evaluation of the DM/DM materials in the 
next section. ' \ 29 , 



SUMIVL^TIVE EVALUATION OF DATA MANAGEMENT & DECISION MAKING 

The purpose of the smninative evaluation of the Data Management & 
Decision Making materials is to determine the worth of the final* outcome 
of the developmental process executed In this project. The materials 
studied are therefore those* which emerged from the Interim stage of product 
development. The purpose of this report is to conamunicate the results of 
this evaluation to the audiences intere'sted in the product and those ^^responsible ' 
for decision making with respect to this product. 

All persons reading this report should take note of the possible sources 
of bias which may exist in those individuals who executed the summatlve 
evaluation and who prepared the report. The circumstances were such In 
the Computer Technology Program thgt the person prhnarily responsible for 
product evaluation within the program was initially assigned the responsibility 
for developing the DM/DM materials. After the initial development, this 
same person conducted the formative evaluatibns of the product though he 
was no longer directly responsible for the development of the materials. 
,-Finally, this person* also executed the summatiye evaluation of the product. 
Thus, the possibility of co-option does exist; however, the responsible 
evaluator attempted to the best of his ability to* maintain maximum 
objectivity throughout the evaluation. Since this might not prove sufficient, 
this summatlve ^evaluation was also reviewed by knowledgeable persons within 
the Laboratory who were In no other way connected with the project. ' 
Therefore, while the possibility of bias in this report exists, every reasonable* 

4 

attempt within the Itmitatlons imposed by the funding agency, has been made 

^ ' . r * - 

to minimize this bias. o o ^' 

,3 8/ 



Areas of Concern In the Summatlve Evaluation 

* The s'ummative evaluation of the Data Managrement & Decision Making 
materials was concerned with judging the worth of the product With- respect 
to five criteria. The first of these focused on the empirical justification for 
the development of these materials. The question of concern was whether or 
not there was a demonstrable need for this product.l^ The second concern 
focused on the ability of the product to cause learning — ^particularly with 
respect to the attainment of the objectives specified for the materials. That 
Is, It considered the question of whether or not using the product resulted m 
.the achievement of the specified learning objectives. Tile -third criterion 
focused on a comparison of the developed product with materials which were 
Its likely competitors. It was concerned with determining If DM/DM 
performed better than its likely competitors with respect to a number of 
criteria. The fourth focus of attention In this evaluation was the side effects 
of the product. It focused on determining if the product and its likely 
competitors had tmportaat side effects. The fifth and final concern centered 
on the cost-effectiveness of the product.' It was concerned with determ|alng 
the costs and benefits of the product and comparing them with t;ho^e of Its. 
likely competitors; The following list of questions summarized the mVjor ' 
areas of concern in the sunMnatlve e^aluatlou of Data Management & Decision 
Making. * • ; 

1. Is there empirical evidence of a need for Data Management & 

- ^ t)ecislon'^ Making? ' . . 

2. Does using the Data Management & Decision Making materials, 
cause attainment of the specified goals of Instruction? 
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3. Do the Data Management & Decision Making materials 
perform better than other materials which can compete with 
them in the educational market? , 

4. What are the costs of using Data Manascement & Decision 
Making, how do these costs compare to the benefits of these 
materials, and how do they both compare to the costs and 
benefits of its likely competitors? / ' 

5. What are the important side effects of the Data Mar^gemeot 
& Decision Making materials and hoT\ do they compare to those * 

^- of its likely competitors? 
Assessment of Need ' • j • - * . * 

In order to determine if there was empirical evidence of need for ^ , 
the Data Management & Decision Making materials a needs assessment was 
conducted. That is, there was an attempt to deteimlne if there vvas a heed 
for the results of attaining the goals of this project. ^ - 
To accomplish this task . a survey of flie target groups for this 
product was tmdertaken. From t*he -empirical results of this survey, 
inferences were made about the need for the dI^DM materials.. In the 
following sections, the sample^ procedures, resii^ts and cofaplusions will be 
described and discussed. 

; . • • • ' • % -.i. 

Sample * 

' ■ ' • 'V . 

The population's of interest for this needs assessment were, these 

' \ ' . - 

groups which were specified as the target groups for DM/DM, These 

'gr9ups involved both primary users of 'the materials »ahd those in ^ 

\ . ' • ■ ~^ ■ 

I ■ ■ 

■ ... 3-2 
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decision making roles with respect to using the materials. 'The groups 
were: 

1. Students enrolled In educational administtatLon courses at 
the college or university level 

f / . • • • • r ,v ■ 

2. '^ Ppatftltloners of educational administration 

« 3. Professors of educational administration ^ 

. Sampling Plan 

Each of the three groups was sampled from a defined sub -population 
of the total population of that group! The population of students was 
considered to be all students enrolled In educational administration 
in the United States. The population of practitioners was defined by the 
entries in Patterson's American Education (1973),^ a listing pf all school 
districts in- the United States along with their chief administrators. Tfie 
population pf professors of educational administration was defined as all 

members of Division A (Administration) of the American Educational 

• /■ 

Research Association, as listed in the 19'73-1974 Directory of Members. 

- .. ■ • ^ 

^ ^. Individuals were^gmpled in each of these aggregations so that the 
flnaj sample'was stratified according to group membership. The sample 

of students consisted of 50 students enrolled in educational administration 

* ■ . * ■ * 1 ■ " 

courses at Portland State University. This group contained some practicing 

administrators returning for fiirther education as Well a;s full-time students 

. ' • i 

in educational administration. The practitioner sample was selected by 

randomly choosing tipproxLmately five school districts within each state to 

• * • ■ ■ . 

, yield a stratified national sample. Within each of thesej districts the chief 



administrator was contacted. To choose the sample of professprs, persons 
were selected from the AERA Directory. Each twelfth inrUvidual listed In the 
Directory with Division A membership was selected to be contacted. It 
should be evident that only th6 practitioner sample *was a tmly random 
sample. The professor sample approximated a random sample, arfO the 
students sample was ah '^opportunity" sample". 

Survey Instrument 
The survey instrument was based on the validity of an Inference 
designed to infer need from two "lower order" responses. Since it was 
assui^ied that most gf the survey subjects were not famlliaf/wlth operations 
research terminology, *lt was decided that the problem of determining need 
was to be approached Indirectly. Instead of asking directly If therS was a 
need for training In a specific operations research technique for educational 
administrators, all subjects were asked two related questions, concerning 
problem types theoretically solvable by the operations research techniques of 
concern In this project.^ That is, each subject was presented with a brief 
description of a problem type and asked ^ow frequently they encountered that 
problem type In their "work and what level of need they perceived for tr^nlng 
materials in techniques that could solve that problem type. The Inference 
\^as then constructed that "If a subject Indicated that he 'Encountered ,a. 



problem type In his work and that If he jfelt that 'there was a need for 

appropriate training materials, then It was Inferred that there w^s not 

\ • 
onIy|, desire for appropriate^ training materials, but a genuine need for them. 

That \ls, such responses Indicated that appropriate training materials were 

- \ ' ■ ~ J- ' ^ ' ■ . . 
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wanted and that accomplishment of the goals of these materials would be ^ 
of some utility in. solving problems encountered by educational administrators , 
To illustrate how this was accomplished, a sample item is sho%vn below. 
See Appendix B for the full form pf the instrument. 



r 



PnOBLEMS 

EKCOl^NTERED MANACHTHIAL H NCTION TRAINING MATKHIALS 

Please check only one l)ox. _ Please check only one box. 

Needed - 

Soma- Hardly ' Needed 3ul Not 

Often time Ever Very Much Eagenf tal N'o« N>H«'d 

13." Ftcdiciing changes in 5chool enrollment 



Fig. 1. Sample item from the needs assessment instrument. 

Procedures 



The pj:ocedures involved 'in executing the survey Involved drawing the 
samples, mailing pout the instrument, arid tabulating the responses. Clerical 
personnel selected the survey subjects according to the samplpi/g procedures 



as specified in the sampling plan. The names drawti from the professors* 
and practitioners samples were typed on, reproducible labels and stamped 




self-addressed envelopes ^yere prepared. An Introductory, letter (see Appendix B) 

^ " . ' A 

was prepared by the evaluator and attached to each copy of the instrument. 

In addition, all professor and practitioners instruments, along with the 

■ * • . ■* • 

introductory letter and the return envelope ♦ were mailed to each subject. 

After a period of 30 days, all instruments whicii had been returned were 

checked off against a master list of instrument numbers. These returns 

were to two types — completed fontns and mail not deliverable. For those 

subjects it was not possible to oojitact (I.e., mail n^t^deliVerable) 



replacements were drawn from the populations as in the original 
sampling. These new subjects, and all other, subjects whd^had not ' 

7 . ' ^ 

responded to the first mailing were sent a secon«i-m airing, identical to 



the first. This completed, the attempts to contact Objects. \ 
After an elapsed time of approximately si^ months, the survey 

\ ' / ■ ... : ! 

Instrument was tabulated and the results analyzed. First, the forms 
were divided into three ^^oups corresponding to the three" groups of,' 

. ■ . / ■ • * ■ ' /' ' 

Interest. The respon'ses were tabulated In matrLx form as ii\ FLg. |2. 





/ . 
/ 




•1 " 




/ 


\ 

Problems Encountered | 






Often(l) 


J Sometlmes..(2) . , Hardly Ev|er (3) 




Needed 

very much (4) 


•Level 1 
Response 


0 * *" ' 1 ■ ! 
^ * 1 ' 


Training 
Materials 


Needed but 

not essential (5) 

Not 

needed (6y 




Level 2 , : ' 
Response ' ' i ' 

: c — : " — ' — ■ \ 



Fig. 2. Possible combinations of responses as portrayed by a matrix. 

<\* . ' ^ 

Since there were two responses ^or each item and thro-^* ^ss lb le levels for 

" ' ' ' '\ ' 

each response the data were tabulated in a 3x3 matr jntaining all *\ 

possible combinations of responses, where each entry represented the totaI^\^ 

number of responses of that type for that' group. Since all the operations 
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researcti techniques of Interest to this project were represen^ted by 
more than one problem type, the matrices fo^* eacn technique were 
aggregated In order to derive a total response, matrix for each technique. 
The Combinations of Items which were used to' calculate the total responses 
* for each technique are given In Table 1/ f \ , ■ 



Table I. 



Correspondence of Questionnaire Items with Content of DM/DM 



Conterit Area- 


Pertinent Iteiri^ 


i. Operations Research- 
in Education 


1, 8, 14 


^ 2. PERT/CPM .1 


2, 3, 6, 10, 15 


3 , L inear Programming 


4i 11, 15, 16 


4. Queue ing Tlieory \.\ 

■ ■ ■■■■ ■ ■ ; 

5. Computer' Simulation \ ' 


5, 7, 12 


9, "13, 17 



Then In 'order to translate the results Into readily comparable teAnS, the 
entries in each total matrix were transformed into percentages of the total 
responses for that matrix. At the next level of summation, percentages 
were calculated for the matrices of: 

^ ■ .* - 

1. Each technique across- all groups 

4 ' 

2. " i!ach group 'across all techniques 

3. Overall responses across all grbups and ajl techniques. 

Finally, in order to facilitate interpretation, two additional figures. w§re ^ 

calculated for each technique In each group, and the three listed above. The 

first of these was billed Level 1 response and was the percentage of responses 

in each matrbc which 'rated a tee'Riiique as. pertaining to problems which were 

often encountered and in which training was very much needed. The second 

was the Level 2 response and was the total percentage of responses which 

indicated that problems related to techniques were at least sometimes 

encountered and training was needed if not. essential. Thus the Level 2 

response included Level 1 response. See> Figure 2 for a pictorial 

representation of these two figures. The final analysis performed on this 

data was to test the difference! on Level 1 and Level 2 responses among the 

groups by means* of a t-test on the proportions. . 

' Results ' / 

The first resiilt calculated was the response rate for the survey — the 

percentage of subjects w^o responded to the survey. The student response 

rate was 100% due to the ..nature of the administration procedures. The 

response rate for the sample of practitioners of educational administration^/ 

« • •> ♦ . • 
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65% and the response rate' for the professors of educational administration 

'. ' ■ V* 

was 63%. . 

^ The basic results of the survey, the total response matrices, and 
pefcentage matrices are presented respectively in Tables 3 and 4, on the 
next two pages. Since these tables are large and complex and their 
Information density is so thin, these tables are Included here for perusal 
but they will not be directly ^discussed, • *^ 

The most important results of this study, the Level l and Level 2 
responses, are given in Table 2. The first figures that this table presents 



Table 2 

Data Management & Decision Making Needs Survey — 
Perceiftage Indicating Level 1 and Level 2 Responses* 



Technique 


Students (1) 


Administrators (2) , 


Prof, of Ed. Admin. 


A All 


Level 1 


Level' 2 


Level X 


Level 2 


Level 1 


Level 2 


Level 


1 Level. 2 


Analysis of 
Decision-Making 


V. 

45 


85 


44 


85 


50 


87 - 


45 


^84 


PERT/CPM 


3** 

50 


91 






39^'- 




46 


88 


Linear 

Programming 


o 

43"' 


0 

38 






51^ 


o 

91" 


53 


91 


Queue Ing 
Theory 


26 , 


71^ 




89=''^ 




o 

76^ 


27 ■ 


79 


Computer 
Slmulatioor ' 


20 


63^ 


■ 23 




27 


67 


25 


. 68 r 


i 

Total 


o 

38''- 


30-"* 


43l'3 


61^'' 


o 

• 39*' 


84^'^ 


41 





'* Level 1 response: Indicating thatva type of problem Is often encountered and training Is needed very much. 
. Level 2 response: Indicating that at least a problem type Is encountered sometimes and that training Is 
needed, If not essential. (Level 1 Is Included.) 
,. ■ /' 

** Indicates that the Student Level 1 response no PERT/CPM Is .significantly different at the .01 level from 
the Lfevel 1 response of Professors of Educational Admlnlstrat'Con (3). 
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are the Level 1 and Level 2 responses by technique within survey group. 
Student, practitioner and professor Level 1 responses Indicated thit all groups 
considered the Intrbductioii^to operations research, PERT, an^^rear . 
programming to be the three areas in which training materials were most/ 
needed. For all three groups much smaller Level 1 responses. wBre given 
for queuelng theory a5id computer simulation. For the first three techniques 
the Level X responses across all three groups ranged from 39% tc 60% 
Indicating that approximately one-half of the respondents In each of the groups 
felt that these were techniques which solved frequently-encountered problems 
and were techniques for which training materials were much needetd. Level 2 
'responses for each of the groups followed essentially the same pa.tem as 
those for the Level 1 responses with one exception. Administrators gave a 
high Level 2 response to queuelng theory. It Is Important to note that ' 
practically aU 'Level 2 responses exceeded 70%, except for students' and 
professors* responses to computer simulation which were slightly less. 

Significance tests among the Level 1 and Level 2 responis3s 
within techniques across groups revealed a number of significant differences; 
however, most of these differences^ were reasonably Small In that they ^id 
not* exceed 11%. The^ one exception was between the Level 2 respDnses for 
students and administrators to queuelng theory. The response for the 
administrators exceeded the response for the students by 18% and proved 
to be the second highest response for th3 practitioners. 



\ Tal?le 3 r ' 

Total Response Matrices for Each Technique for Each Target Group. 









Students 


x Administrators 


Professors 


of 


Ed. Admin. 


Introducxlon to 




1 




2 


3 




1 


2 


3 




1 




2 


3 


Operations 




O Q 






o 


4 


210 


80 


3 


4 ^ 


^3 




49 


11 


Hesearcj^ 


C 
3 


1 




9Q 


11" 


5 


11 


107 


17 


5 


17 




122 


15' 




C 

D 1 


n 
u 




1 


10 


5 


1 


11 


37 


6 


2 




9 


23 • 








N 


= 148 








N = 482 








N 


= 501 




PERT/CPM 






1 




2 


3 




1 


2 


3 


t 


1 




2 


3 




A 
*X 


1 9 J. ' 






q 


4 


392 




5 


4 


305 




132 


3 


\ • 


> C 








g 


5 


34 


183 


15 


5 


57 




213 


23 




6 


0 




1 


4 


6 


46 


17 


39 


6 


11 




13 


25 








N 


^ 249 








N = 810 








N 


= 782 




Linear 




1 

X 




p 


3 




1 


2 ' 


3 




1 




2 


3 


Programming 




A 
*x 


96 






4 


4 


389 


62 


1 


4 


348^ 




71 


10 




c 


Q 
O 






9 


5 


33 


129 ' 


7 


5 


60 




14*8 


12 




c 

D 


u 




O 


3 


6 


6 


5 


17 


6 


1 




9 


20 


^\ 






XT 


— 1 QQ 








N = 649 








N 


^ 689 




Queue Ing 
Theory 






1 




O 
£t 


3 




1 


2 


3 




1 




2 


Z 




4 


38 






A 
*t 




160 


61 


3 


■ 4 


111 




60 


8 




5 


9 




•to 




5 


27 


179 


li 


5 


23 




181 


31 


- > 


6 


" 0 




1 




6 


4 


13 


25 


6 


1 




20 ' 


•60 








'■^^ 


= 148 








N = '483 








N 


= 495 




\ 

Computer 
Simulation / 






1 


2 


3 




. 1 


2 


3 




1 




2 


3 




4 


V 30 




26 


8 


4 


134 


. 68 


3 


4 . 


132 




66 


10 




5 


\ 




31 


21 


5 


16 


140 


23 


5 


21 




114 


'30 






6 


V 




1 


27 


6 


. U 


14 


76 


6 


. * 0 




26 


93 ' 








> \ 


N 


= 151 






'N = 485 








N 


= 492 


Total 1 






l) 




'-2 


3 




1 


2 


3 




. 1 




. 2 


3 




4 


322 




129 




4 


1181 


355 


20 


4 


1113 




360 


42 




5 


37 




192 


72 


5 


126 


714 


71" 


5 


167 




747 


108 






0 




6 


60- 


j6 ^ 


31 


58 


190 


6 


15 




77 


218. 








N 


= 843 








N = 2746 






N 


= '2847 






\ 








































OVERALL 




























1 


2 


3 
























4 


2616 


844 


87 
























5* 


330 


1653 


^51 
























6 


46 


141 


468 




























N = 6436 













See Fig. 2 for the responses corresponding to the numbered categories. 
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Table 4 



4 
5 
6 



Percentage Response ]\/Iatrlces for Each Technique for Each 
Target Group' ark^ummary Percentages 



students 



45 
1 
0 



50 
5 

• 0 



48 
4 
0 



26 
6 

. 0 



20 
5 
0 



19 
20 
1 



16. 
20 
0 



14 
22 
1 



9 

3a 

1 



17 
1 



4 
3 
2 

3 
2 
5 
4 



3 
'3 
16: 
10 

3 
5 
14 
18 



\ Administrators 



,44 
2 
0 



17 
22 
2 



48 
4 
6 



10 
2? 
2 



60 
5 
1 



10 
20 
1 



33 
6 
1 



13 
37 
3 



28 
3 
2 



14 
29 
3 



3 
2 
4 
8 

3 
1 

'2 
5 

3 
0 

3 

3 
1 
2 

5 

3 
1 
5 
16 




Prof of Ed Administration 



51 
S 
0 



10 
21 
1 



4 . 

5 ' 

6 ' 



22 
5 
0 



12 
37 
■ 4 



27 
4 
0 



13 
^3 
5 



3 
1 
2 
3 

3 
2 
6 
12 

3_ 
2 
6 
19 



All Groups 



45 
2 
0 



15 
22 
2 



46 
5 

2 



14 
23 
1 



53 
6 
0 



11 
21 
1 



27 
6, 
0 



11 
35 
3 



25 
4 
1 



15 
24 
3 



2 
4 
9 

' 3 
^3 
8 

18 



Total 



38 
4 
0 



15 
1 



43 13 
5 26 

I ^> 2 



39 
6 

1 " 



13 
26 
3 



OVERALL 



41 13 
5 26 
1 2 
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Table 2 also presents the Level 1 and Lev^l 2 responses of all three 
groups combined for each of the techniques. These appear In the last set 
of columns In the table. These figures repeal a similar pattern of responses 
for both levels • The highest rat^d was linear programming (53%, 91%) \ 
followed by PERT (46%, 88%), Introduction to operations research (45%, 84%). 
queuelng theory (27%, 79%) and computer simulation (25%, 68%). Level 1 
responses ranged from 25% to 53%, while Level 2 responses ranged from. 
68% to 91%. ' '■ ' ' 

Finally, Table. 2 presents the responses acrbss all techniques , 
combined for each of the three groups and their aggregation. These figures 
appear In the last row of the table. The practitioners gave tW highest level 
Level 1 (43%) and Level 2 (37%) responses of all the groups, which were. In 
fact, significantly greater than the responses' for either of the other two groips. 
The responses of the students and professors were essentially slirvllar, with the 

exception of a significant 4% difference between Level 2 responses. The finaK. 

' ' m- ' 

smnmary figures are the Level 1 and Level 2 responses across all groups 
and all techniques. These were 41% and 85% respectively, these last 
^ figures would appear, to Indicate a reasonable level of need for the technique^. 

Conclusions , 

• ■ ■ \ ' 

Several concluslona are readily evident from the above stated results. 
First, since almost all Level 1 responses exceeded 25% It may be conducted 

that at least one--quarter of all surveyed groups saw the problems related to 

"-. ■ ^ 

operations research techniques as encountered often and felt that need fof 
tpaLning In these techniques was -great. Secohd, since almost all of the Level 

ERIC - . ^ 51 / 
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responses exceeded 66%, It ny(y be concluded that at least two-thirds of all. 

surveyed groups saw the problems solvable by the operations research 

J . ■■ r 

techniques as sometimes encountered and that training in these areas was 

/ 

needed, if not essential. Third, the survey revealed that all groups surveyed 
had differential perceptions with respect to the different techniques, with 
llnear^.^fogramiiling given the highest response. Fourth, the practitioners 
{6t educational administration seemed to hold these techniques In greatest 

1 ^ ' ' " ^ ^ • 

'value. And fifth, for the total package of techniques across the combinea 
^ groups, slightly less^ than half the respondents perceived It as being greatly 
ne^,ded, while more than four-fifths perceived the package to be needed if 
not essential. Thus it would appear that "there exists gtrong- evidence of 
need'^for Data Management & Decision Making, 

Before drawing the final conclusion, howevet. It is appropriate at , 
this? time to discuss briefly some of the cautiorfs concerning the conclusions. 
It should be evident that the student sample' was drawn from a single 
university in a specific geographic region, and thus may not be representative 
of the entire population of students in educational administration. In 
addition, there may be some blas/m the professors of educational administration 
sample. Since all respondents were members of a research organization,, it 
is possible that there is a bias in this group toward using scientific techniques 
for problem solving, and thus a higher level of response may be given that is 
actually; the case for the entire population. Since these sources of possible 

bias exist the strength of the conclusions must be tempered, ' 

/ . ■ ■ ■ ' . ' 
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What may be concluded from this survey is that among Important ^ ^ 

* • . \ . . ' ' 

decision making groups, though they may not .be entirely representative of 
"the target groups specified for the pr9duct, there /is strong evidence of 
need for training in the techniques of operations resear.ch as specified in 
Data Management & Decision Making > Among students -In educational 
administration, there Is some evidence of perceived need but it is not 
possible to generalize this to the entire populatlori. ^ • ^^^^ " 

Field Test of Product ; " . - * . , 

. T^ie field test of Data Management fc^ Decision Making dealt with 
three aspects of the summative evaluation — achievement, competitors and 
side e£fects. As previously stated, however, thfese concerns are 
Insufficiently precise for conducting an experimental inquiry into the ^ 
effectiveness of the DM/DM materials. In the following. paragraphs the 
evaluation questions will be refined so as to derive testable hypotheses, 
for the field test, * 

The first aspect, achievement, has to do with whether or. not the> 
.product is able to cause achievement with respect to the goals of instruction. 
If we define learning as a positive change in the level of goal attainment^ 
then the question becomes one of learning. Consequently, one of the questions 
this /field test inventigates is whether or not the DM/DM materials cause 
cognij^lve. learning, ' For, purposes of generating the experanental sltiaation, 
^this' question was phrased as: ' 

^'Do 4;he DM/DM materials cause a si^ificai^t-positiverchange from. . 
pretest to posttest on a questionnaire designed to measure attitude - 
toward operations research in .education?^* ' ^ *' 



The second aspect of the field test; ' competitors, has to do with 
comparing the, DM/DM materials to possible competitors in order to 

ascertain if the)r>''do better'^ thaiiithelr competitors. , We are therefore 

•j ■ ' 

Interested In deterininlng whether or not the DM/DM materials compare^ 
favorably with their competitors with respect to a number of crltef la. 'in 
this field test two particular criteria .are of Interest—cognitive learning and 
attitude change. For the purposes of the field test these concerns are 
phrased In the form of two questions: v . ' ' ' 

^'Are the statistically adjusted posttest scores on a test 
designed to measure ^objective attainment for the DM/DM . 
materials significantly better than those of Its competitors? 



and 



; ^^Are the statistically adjusted posttest scores on the tnstrUmerit*^ 
^ designed to measure attitude toward operations research In • 

r education for the DM/DM materials significantly better than 

those of its competitors?^^ ' ^ 

The third and final aspect with which this field test Is concerned . 
Is the question of side effects. That is,* the investigation Is Interested in 
determining If there aie important outcomes of using the DM /DM materials,, 
which were -no t^ planned for In the original description' of the Intents o| the 

materials. ' A subsidiary matter of concern in this area Is a :,comparlsoa 

/. ■ . ' • ^ 

between the important side effects of the DM/DM materials and its 

■ ■ , ■ . /■ w' ' ■ ^ ■ •, 

competitors. - . ' . 
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It is Lmportant to note that the questions as phrased above Imply 
that it is desired to evaluate the overall performance , of the DM/DM 
materials. This is not the case. Since the materials were originally 
designed so that the instruction on each technique would be independent of 
aryy other of the units of instruction except for the introduction, it is 
appropriate to focus on how each unit performs. Consequently this evaluation 
is concerned with how each of the questions stated above is answered for 
each of the units of instruction. 'Introduction to Operations Research'^ is 
not included since it is intended merely as an '^advanced organizer'* for the 
four technique units. Therefore this evaluation will attempt to answer each 
of the sLx evaluation questions stated Ln the previous paragraphs for each . 
of the four technique units — 'TERT/CPM: A Planning and Analysis Tool/' 
**Linear Programming/' ^^Queueing Theory'* and '^Computer Simulation/' 

Design of the Field Test 

In the following sections the sample and sampling pr(5cedures will 
be described, the testing instruments will be depicted, the procedures 
explained and the analyses delineated. . ^ 

Sample. The sample for this field, test was drawn from the 
primary target populations of the DM/DM materials. It consisted of students 
in educational administration courses in universities at the graduate level/ 
Due to. the nature of postgraduate education in the field of education, the 
sample included both practitioners of educational administration and full-time 
students In educational administration. The sample was drawn by contacting 
profess<5'rs of educational administration at several universities around the 



country and asking for their cooperation in tKis field test by making their 
classes in educational administration available. This search revealed four 
such persons _\vho were willing to cooperate. Three of these were at the 
University of Iowa (UI) and one was at Northern Arizona University (NAU). 
These persons volunteered a total of six graduate classes for the field test. 
Two of these classes were at NAU arid totaled 27 students. The other four 
classes were at UI and totaled 75 students. - 

* Table 5 reports a number of characteristics of the sample which 
'are considered relevant for this field test. At both schools the predominant 

W Table 5 

Descriptive Characteristics of the Sample Used in the Field Test 
of Data Management and Decision Making 





SCHOOL 




NAU 


UI 


Position 










Student 


2 






20 ^ , 


Tcricher 


7 






28 


AdminisLrator 


1 






14 


Other 


G 






3 


Mo Rctiponsc 


11 






10 


Bachelors 








20 


M.'istitrs . 


15 






41 


Doctorate 


1 






3 


No JO.'i-:i>onse 


11 








i^Adminj. 1 rafivc 










0 


15 






34 ' 


\ 1-5 years 
, 6-10 ycnr^ 


1 






13 
6 ^ 


11-1[> years 








7 


IG h 








3 


^ No Response 


31 






12 ' 
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number of respondents were either students or teachers. While .there 
was only one practitioner at NAU, there were 14 at UI, a reasonable 
number considering that the courses were in the fall term. Most of the 
degrees held were either Bachelors or Masters with a very few Doctorates. 
The predominant years of experience in administration was zero for both 
schools. At UI approxbi^ately one-third or the subjects had some 
administrative experience ranging from 6 to 16 years. From this Infor- 
mation it would appear that the subjects sampled met the specifications 
for the target groups for the materials in that they are generally either 
students or administrators returning for further education generally at the 
graduate level, thoujgh there is a predominance of potential over practicing 
administrators. . * 

Instruments. Ten instruments were designed for this field test. 
They were intended to measure both the cqgnitive and ^affective outcomes 
of the products and their competitors. Eight of those were cognitive lean>ing 
instruments constructed in four subject-matter pairs. Each pair was usejK 
to measure cognitive learning with respect to one ..of the four operations 
research techniques--- PERT, linear programming, queueing theory and 
computer simulation.*^ The purpose of constructing the instruments in pairs 
was to provide parallel forms dfor use In, a pretest-posttest' situation. Each 
I form in the pair of instruments was constructed so.that each item 

corresponded to an instructional objective for the unit concerned with a 
particular technique. Thus in each instrument-paif^there were two items 
S^r each instruct ional^ol:|j§jbt Lve~rone on one form of the instrument and one 

on the other. All instrument-pairs .were evaluated during\the pilot test of 
/ . . ' - 49 
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the materials. They were found to be generally acceptable according 
to some heuristic criteria for objective-referenced tests, . Before the field 
test, however, some item pairs were revised to correct for deficiencies 
discovered Ln the pilot testing. After the completion of the field testing, 
internal consistency reliability coefficients were calculated for each of the . 
forms in each of the instrument pairs. Since the item scores were variable 
rather 'than dichotomous, the Kuder-Rlchardson Formulas were not appropriate 
In this case, the^ measure of internal consistency was that for the reliability 
of a composite test — Coefficient Alpha (Lord and Novick, 1968). It should 
be noted' that, this is not the true internal consistency reliability of the test, 
but rather a lower bound on that reliability. These reliability coefficients 
are reported for both the pretest and posttest In each of the following 



/ 



instrument descriptions. 



/ 



1, PERT: The pair of instruments designed to measure the 




unit as 'listed In Appendix A. These pairs were split 



as described into a pretest and a posttest form with-.a 



total of 34 points on each. These forms took approximately 



45 minutes to complete each. The lower bound of their 




internal consistency reliability as expressed by Coefficient 



^ Alpha was .24 for pretest and . G5 for the posttest. 



Linear programming: The pair of instruments designed to 
measure the content learned from the unit on linear 
programming consisted of 16 item pairs keyed to the 
Instructional objectives for this unit as listed in Appendix A; 
These pairs were split as described Into a pretest and a 
posttest forai with a total , of 30 points on each. Each form 
took approximately 35 minutes to complete. The lower bound of 
of their internal consistency reliability as expressed by 
Coefficient Alpha was .63 for the pretest and .66 for the 
posttest. 

Queueihg theorry: The pair of instrimients designed to measure 
the content learned from the unit on queueing theory consisted 
of 17 itehi pairs keyed to the instructional objectives for this 
unit as listed in Appendix A. These pairs were split as 
described into a pretest aad a posttest form with a total of 
30 points on .each. These forms each took approximately 
35 minutes to complete. The lower bound of their Internal 
consistency reliability as expressed by Coefficient Alpha 
was .60 for the pretest and .71 for the posttest. 
Computer simulation: The pair of instruments designed 
to measure the content learned from the unit on computer 
simulation consisted of 16 Item pairs keyed to the 
instructional objectives for this unit as* listed in Appendix A. 



These pairs were split as described into a pretest and. 
posttest form with a total of 34 points on each. Each 
form took approximately 40 minutes to complete. The 
lower bound of their internal consistency reliabilities as 
expressed by Coefficient Alpha was . 62 for the pretest 
and .72 for the posttest. 
Each of these instmments was scored in two ways. The first 
score reflected achievement on the entire set of cognitive objectives for 
each DM/DM unit, aCid was the total points scored on ,the test. This score 
was known as the Full Cognitive Test Score. In order to make a more 
rigorous comparison between the IM/DM materials and their competitors, 
an additional score was calculated. This score was determined by adding 

c 

up the scores on items which reflected objectives in common for the two 
sets of materials. This score was called the Common*Objectives Score. 
Both these ^^co res were then used to compare the two sets of materials. 

Tbe two affective measurement instruments were designed to' 
measure attitude toward using operations research in education and toward 
using the developed products as a Ifeaming tool, and feelings about the 
structure within which the materials ^^ere used. A copy of each of these 
instruments irn'ay be found in Appendix B. The first of these instruments. 
Questionnaire 2a, was used to measure attitudes ^oth before and after the 
products were used. This questionnaire consisted of 18 statements with 
five point Likert scales of agreement. The first 10 of these items were 
designed to measure part icipant&V attitudes toward using operations research 
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in education. The measure of the attitude was the average response on 
the 10 items by each individual. The last, eight items dealt with attitudes 
concerning the materials studied. In using this questionnaire as a pretest 
of attitudes the students were instructed to ignore the last eight items. When 
the questionnaire was used as a posttest, the students were asked tp respond 
to ail items. The internal consistency reliability of the first 10 items of the 
questionnaire was evaluated by means of Coefficient Alpha. For the pretest 
the lower bound of the internal consistency reliability (Coefficient Alpha was 

r ' 

.81. This was judged as acceptable.. No attempt v^as made to evaluate the ' 
reliability of the last eight items since each item was interpreted individually. 

The other instrument; designed , to determine attitudes related to the 
use of these materials was Questionnaire 3 which may be found in Appendix B. 
This questionnaire collected the descriptive data given in the Sample section 
and asked several free response questions about the materi als. These 
quesflons concerned the students feelings about the manner In which they 
studied the materials, difficulties in using the computer, the best and worst 
things about the units they studied, possible improvements, specific criticisms 
their recommendation to others concerning th^se materials, and their overall 
reaction to the materials. 

It is important tp note in judging the quality of these _lnstruments_jyyt'th 
respect to reliabdlity that several factors may have contributed to the rather 
low values. Accurate estimates af reliability of this type are dependent on 
two factors. The items must be approximately hompgeneous and the size of 
the ;^Jimple must be fairly Ifarge in order to obtain a "good** estimate of tbe 
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internal consistency reliability by means of Coefficient Alpha. The validity 
pf both of these assumptions is in doubt, for this field test. ' The objectives 
for the materials specified a number of different pieces of knowledge and 
several skills, all of which are not necessarily closely related. Thus, the * 
items may lack homogeneity in that they atterbpt. to measure different things. 
Second, the group sizes used to determine the reliability were rather small 
(ail less th^ln 30 Ss). The effect of the violation of these, two assumptions is 
that the lower bound of the reliability is generally underestimated. As ^ 
suit all lower bounds on the reliabl^y of the instruments used may be 



re 



underestimated. 

IT- - ■ 

In the next section the uses to which these instrmr its were put will 
be described, ^ 

Procedures 




Tn&Tirst step of the procedures for this field test was the 
identification and selection of the competitors against which the products 
were to be compared. The first attempt at this involved a search for a 
r ingle product which could compete directly with DM/DM in the educational 
marketplace. This attempt resulted In nothing directly comparable to. the 

DM/DM materials in a single entity. The search then Shifted to a second 

*> ^ 

^oous — locating competitor materials for each of -the four operations research 
techniques units. . In this second phase of the search, materials were sought 
which possessed evidence of empirical validation and which were parallel in 
content to the DM/DM units) The search was unable to 'discover any ^ 
materials which met either of these criteria. There were no units of 



instruction concerned with the four techniques of operations research which 
were empirically validated. In addition, there were no materials which 
included both a discussion of the operations research techniques and 
emphasis on using them as computer-based problem solving tools. The' 
search did reveal, however, a number of units of instruction that did 
speak to a subset of the instructional goals specified for the DM/DM materials. 

PERT and/or CPM has been a popular instructional subject in many 
fields of managcmfent for about the last ten years. This popularity has 
resulted in a profusion of^ tests and instructional materials on the subject. 
However, without e.^eption, they maintain an abstract or general business 
-emphasis. Problem examples are generSlly concerned with demonstrating 
the application of PERT- or CPM to general management tasks or typical 
business projects.- Nowhere was- there any evidence of concern with problem^'- 
characteristic of educational administration. Thus, it was not possible to 
select a competitor that was concerned with problem solving in educational 
administration. The best that could be done was to select an acceptable 
general test concerned with PERT and/or CPM. 

The competitor selected as being the best treatment of the subject 
within the stated restrictions was A Programmed Introduction to PERT (1967). 

( ..' • 

This particular text was chbsen for several reasons. F.irst, being programmed 
instruction, it was intended to be largely self-instructibnal as was the DM/DM 
unit on PERT. The basic objectives concerning the technique were 
essentially the same as those expressed for "PERT/CPM'\ The text was 
fairly short and was estimated to take the same amount of instructional tim§ 
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as *'PERT/CPM-" ;And finally, this text was not heavily business oriented. 
For purposes of the field testing the text was modified slightly in that a 

r 

section concerning probability calculations using PERT was deleted. This 
was done sirce research dealing with PERT has revealed that these 
calculations are quite often spurious and useless (Cook, 1968). 

There are also a number of texts which deal with linear programming; 
however, most of these are written at a very sophisticated level and are often 
heavily mathematical. Most have been written either by econometric ians or 
mathematicians with the intelat of communicating the mathematics of the 
techniques rather than its uses. Only a very small number of texts deal 
with applying linear programming to practical problems, and even fewer with 
applications of linear programming in education. 

The competitor selected as being' the best treatment of the subject 
within the stated restrictions was Making Reliable Decisions with Linear 
Programming (1968), published by the American Management Association, 
This text was also chosen because ii*was a progranmied text and therefore 
highly self- instructional. It covered the same basic topics as -'Linear 
Programming^' including the basic terminology,- model formulation, meaning 
of solutions, and interpretation of the resultis of a^ linear programming analysis. 
In addition, it had a section on using the computer as a tool in linear 
programming, but there was no 'Tiands^on*' experience included. One 
modification was made in the materials. A section on the mathematical 
technique of the simplex method v/as deleted. This was done since it was 
determined that it was not relevant to the important goals of instruction 
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in linear programthing. With this deletion, it was estimated that the 
materials would take as long co work throu^ as "Linear Programming.'' 

The number of instructional materials available in queueiiig theory . 
proved to be quite small. Most information existed in the form of journal 
articles rather than texts. Of the few that were available, most were 
mathematically oriented rnd highly complex. In addition, almost none 
attempted to demonstrate any practical applications of the technique and 
even fewer applied the technique to educational administration. 

The instructional material selected as being the best treatment of 
the subject within the stated restrictions was th6 queueing theory chapter 
frbrr) Educational Decision^Maklhg Through Operations Research, (^anDusseldorp 
et al, i 1971). It was chosen 4s the competitor to '^Queueing TheoryT for 
two reasons. First, it is, to the best knowledge of the evaluator, the only 
non-technical treatment of queueing theory presently available. Second, it 
attempts to deal with queueing theory applied to educational administratioq^. 
Since it was a chapter from a text, Lt was not designed to be largely self- 
instructional in the manner of thejDM/DM materials. Also, "since it was 
only about 13 pages long, it did not take the sam^ time to complete as the 
*'Queueing Theory'' unit. It was selected, however, since it seemed to be 

the only exisV^ng competitor of any similarity. 

\ 

The field! to choose from in selecting a competitor for ''Computer 
Simulation," also appeared at first to be fairly large. A closer examination - 
of the available texts ,revealed, however, ithat the number of directly relevant 
texts was quite small. Most of the available texts dealt with constructing 

sunulations of specific 'systems rather than using existing simulations. 
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In addition, most of these texts were either oriented toward deriving math- . 
ematical equations for portraying a system or constructing systems for 
business applica*^ions,. No available text dealt with using simulations In 
educational administration or involved direct experience with the cou-iputer. 

The competitor selected as being the best treatment of the subject 
within the stated restrictions was a set of chapters from A' Primer on 
Simulation and Gaming , by Barton (1970). While this text^dtd not deal with 
examples ■ of \ computer simulations that educators could use in administration, 
it did discuss some of the terminology of computer simulations and described 
the different types of simulations that did exist and examples of each. The 
discussion was essentially non-technical and non-mathematical as was 
appropriate for the target audiences and it appeared to fit the same time 
frame asyComputer Simulation.*' 

The four sets jot materials described above were chosen as the 

c 

materials with which the DM/DM units would be compared. No competitor 
was chosen for ^'Operations Research in Education" since the primary intent 
of this unit was to serve as an advanced organizer for the other units rather 
than as a primary instructional unit. None of tliese competitors wei^e perfect 
fits with the DM /DM materials, especially since none included hands-^^on 
computer experience; ^however, they appeared to have enough objectives in 
common to warrent their use as standards against which to judge the 
Data i^ganagement & Decision Making units. 

•- 

After the critical competitors were selected, the experimental 

treatments were specified. The particular combinations were determined in 

part by the number .of subjects that were available. Calculations of power 
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(cf. Cohen, 1969) revealed that a group size of approximately 30 subjects 
would be needed in order for a st/atistical comparism between tvvo treatment 
groups to have sufficient powery'to detect moderate treatment effects. Sinp^ 
one major purpose of the 'field test is to compare the DM/DM materials 
against their competitors, it would first appear tt:\t eight groups would be^ 
needed with about 30 students each, or 240 students. Since it was also 
important to keep time to a minimum (ail classes were volunteer classes 
rakuxg time out of their regular classwoiic), the size of the treatment must 
be kept as small as possible. One possible compromise in this situation is 
for each student to study more tlian one unit of instruction. The compromise 
made for the purpose of this field test was that most students would study 
two booklets. For reasons of scheduling and lack of access to computers, 
this was not true for all groups. 

In designing the experiment it was also necessary to control for. 
two sources of bias. One source of bias was the possible effects due to 
different instructors. This was controlled in two ways. First, for purposes' 
oL assignment to treatment, all the NAU classes and almost all o'f the in 
classes were combined into single groups. Then students within each of 
these groups were assigned randomly to a set of treatment conditions. The . 
exception was one class at UI which was an extension class and had no access 
to computers. Therefore, it was necessary to assign them -all to a competitor 
condition. The other method by which- instxnictor-effect was controlled was by ^ 
instructions to^ttiie professors. They were asked to keep their interaction 
with the students concerning tJiese materials to an absolute minimum — 

answering only procedural. questions.- In this way» the effect of teaching style 
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answering only procedural questions. In this way, the effect of teaching 
style was reduced if not ruinimized. 

The other source of bias lay In the possible interactions of the 
materials studied where students studied more than one unit. To control 
this source two methods were used. First, it was decided that' to control 
for interactions among the DM/DM materials and among the competitor 
materials, no student should study two of each. That is, within the DM /DM 
units and within competitor materials, int€*ractions were to be precluded. 
This left only competitor DM/DM interactions, which it was not possible to 
control completely, Smce it was net completely possible to control for this 
interaction, its effects were tested to determine if they actually existed. 
First DM/DM units were randomly paired \vith competitor vmits. Then most 
of the treatments were defined by using both possible sequences of these pairs. 
Due to the problem with the extension class, however, this was not possible 
for all materials, ^he "Computer Simulation* unit and the competitor for 
queueing' theory were assigned alone to groups. The resulting eight treatments 
for this design are given. in Table 6. 

The procedure for administering these treatments c<>nsisted of the 
following steps. These steps were spread over two contiguous class sessions 

at NAU and three contiguous class sessions at UL At the beginning of the 

t ' ■ - - 

first class each instructor briefly explained what the students were going to do 

• - ' ^ 

described the nature of the field test and assured the students thvt their, 

i • . 

performance on the tests they. were about to take would remain anonymous 
and have no' effect on the-ir ^rr/ie in the course. Thej' then* distributed a. 
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\ ' Table G 

Trcatnicnt Groups for the Field Test of DM /DM 



Group No. 


University'^ 


Treatment 1^ 


Treatment 2 




4 a 


UI 


PERT/CPM 


CSC 


9 (10) 


. lb 


III 


CSC 


• PERT/CPM 


8 (10)- 


' 2 a 


UI 


LP 


PC 


7 (10) 


2b 


UI 


TC 


LP ■ 


8 (10) 


:5a 


NAU 


■ ' QT 


LPC 


8 (13) 




NAU 


LPC 


QT 


8 (14) 




V'l 


CS 




14 (16) 


5 


UI 


QTC 




"13 (17) 



UI - University of Iowa, NAU - Northern Arizona University 

PERT/CPM - PERT/CPM: A Planning and Analysis Tool 
PC - PERT/CPM Competitor ^ 
LP - Llneap'T^rograinmlng 

LPC r- Linear Programming Competitor' • ' 

QT - Queueing Theory . , „ 

QTC - Queueing, Theory Competitor 

CS - Computer Simulation . . ' 

CSC - Computer Simulation Competitor 




packet containing the attitude questionnaire, pretests over the unit(s)^ 
assigned to the student (these were in the same order as he was to study 
the booklets if he was assigned more than one), and the assigned units. 
Students were asked to first complete the cuestioimair^e and then complete 
the pretests in the order that thf.y were v. che packet. Th^ students were 
instructed to answer only those questions for which they knew the answer and 
to avoid guessing. \ • 

The students were then instructed to begin studying the first unit that 

\ 4 ■ y ' ■' / 

they found in their packet. That is, they were instructed to read' the^ materials,^ 

work the exercises as they came to them, and interact with the computer at 

■1 

the specified points if they were studying a DM/DM unit. They were also given 
explicit instructions to work' through the units they had in the order that they 
appeared in the packet, and they were informed that the instructors were to 
help only with procedural questions such as how to use the computer terminal. 

The posttesting sessions differed for the NAU and UI groups and "also 
within the UI groups. -At NAU, at the beginning of the secoi^ class session., 
each student receded a packet of tests corresponding to the units he studied. 
The student was instruc^d to first complete the test over the first unit he 
studied and then to complete the^^s^^T^nd'^^ students ^ere asked 

only to complete those items for which they knew the answers. After 
completing the cognitive tests, students were asked to com^plete the full 
attitude questionnaire. Finally, they wei'e asked to complete a Questionnaire 3 

for e^ch of the units that they studied. The two single treatnient groups" at 

ft . 

UI (gi'oups 4 and 5) went through a similar procedure except that y;iere were 



/ 

/ 

/ 
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no second forms of the cognitive instruments and Questionnaire 3. yie 
sLx groups at UI (la through 3b) who had two units followed essen|/{klly 
tfie same procedure except that there was a two-week lapse betvii^een the 



// 
// 



two testing sessions. As a final step in the procedure, all /instructors 

•^ere interviewed^ after the conclusion of the testing; to obtain their impressions 

of the materials and how ^ they worked. 

Analyses > 

In order to check If the sequence of materials 'had any\..effect on 

' / • ' . - 

either cognitive learning or attitudes, it was necessary ^^^ompare the 

pretest scores, the posttest scores, and posttest attltudes-between ^he. members 

of each pair of groups. Thus, th^se scores were compared between groups la 

and lb, 2a and 2b and 3a and 3b. These group differences were statistically 

tested by means, of a t-test. 

To determine if cognitive gains were caused either by the DM/DM 

materl^ls'"or the competitors. It was necessary to compare the pretest and 

posttest /performance on the cognitive [nstrument}pairs for each of the unit, . 

In the event that the seque^nce effect was significant, this test would have to' be 

i 

carried out for each of the groups that received two units; however. If the 
sequence effect proved not to be significant, each of the pairs of groups that 
studied the same materials could be combined. The statistical procedure for 
testing these ^alns was a correlated t-test on the gains from pretest to 
posttest for each of the groups. Attitude change was to be tested by the same 
method for each group. 



The final analysis had to do with comparing the performance of th^ 

DM/DIVIo units against their, competitors with respect to cognitive learning 

and attitude change. This was accomplished by using an analysis of 

qovariance with one factor and two levels of treatment corresponding to a . 

DM/DM unit and its competitor, for each unit. The covariate used was the 

pretest score on the appropriate insfrtiment. 

Results of the Tield Test 

Means and standard deviations for each of the "subgroups for each of 

4 

the Instrumenfs used in the field testing for each testing session are given' 

In Table 7, with the exception of the results from Questionnaire 3. Since 

these figures do not relate directly to the evaluation questions even though 

they form the basis of the data, they will not be discussed here. 

In order to determine the structure of further analy^ses, it was first 

necessary to analyze the sequence effects for the materials. The means, 

standard deviations and t-tests between the groups with the different orders of ^--^ 

n^iterlals are glve'h In Table 8. This table compares the ;^;Cores on tests 

) 

concerning a particular unit when that unit is studied first or second. 
These means and t-tests are given for the pretest and posttest cognitive 
Instruments, the subset of common objectives both pre- and post, and the 
attitude posttest. It is evident from the table that there was no difference in 
performance which depended on the order of unit studied for any of the measures 
used in the field test for an^^ of the groups. Thus, It would appear to be true 
that the order of study of the units does not affect the subsequent performance . 
on instruments designed to measure either cognitive ^learning or attitude change. 
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Table 7 

Means ard Standard Deviations for Each Treatment Group 
In DM/DM Field Tes^ 





Group^ \ 




la 


lb 


2a 


2b 


3a 


3b 


4 


■ 5 ' 


ATTITUDE V 


































X 


2.25 


2.40 


2..'?8 


1.86 


2.27 


2.09 


2.23 


2.18 


SD 


.20 


.74 


.15 


.47 




.50 


.41 


.59 






















2. IX 


2.05 


2fOl 


1.88 


2.14 


1.92 


2.13 


1.96 




.34 


.53 


.68 


.54 


.41 ' 


.SI 


.47 


.28 






















2.65 


2.38 


2.98 


2.54 


2.24 


1.89 


2.49 


2.60 


SD 


.54 


. 80 


.61 


.74 


.55 


.51 • 


.48 


.36 




















operations Hesearcb 


















Pretest ^ 


















3c 


5.10 


4.7ac^ 


6.22 


.1.56 - 


6.73 


5.85 


3.69 


5,50 


SD 


1.52 


3.77 


4.60 


2.40 


4.24 


3.46 


1.99 


2.42 




















X 


1 o in 


21 . 13 


16 30 


17. 50 






14. 87 


18. 00 


SD 


5.88 


3.23 


5.59" 


6.06 


5.88 


2.73 


6.50 ^ 


5.20 


Treatment 1 


















Pretest 


















Full CognUlvo 


rovXiT / 

{riLts 1 / 
















X 


CPM) 


(CSC) 


(LP) 


(PC) 


(QT) 


(LPC) 


(CS) 


(QTC) 


2. 50 


11 . 10 


3. 89 


4» 11 


10. 82 


5.38 


11.88 


9. 44 


SD 


1. 96 


90 


4.2** 


C 2.09 


6. 66 


2. 93 


4.99 


6. 9C 


Comxson Objectives 


















X 


2.50 


3.00 


3.89 


- 3.78 


6.36 -"^ 


5.31 


2.75 


5.69 


SD 


1.96 


.94 


4.28 


1.92 ' 


3.83 


2.84 


1.3$ 


3.65 


Posttest 


















Full Cognitive 


















X 


19.90 


15.38 


10.30 


15.10 


17.70 


11.44 


21.07 


17.93 




7.91 


'*6.46 


5.81 


7.72 


9.J67 


3.28 


5-94 


6.83 


uozninoo L/Djcui ivcs 


















X 


18.20 


5.25 


'9.50 


14.30 


10.50 


10.11 


6.64 


li.50 


SD 


7.47 


1.49 


4.^7 


7.35 


5.99 


2.76 


2.53 


3.32 


TreatiTtent 2 




































Full Cognitive 




(PERT/ 
















(CSC) 


CPM) 


(PC) 


(LP) 


(LPC) 


(QT) 






V 


13.30 


4. 20 


2.00 


4'. 67 


6.64 


7. 00 






SD 


6.02 


2.97 


1.51 


1.58 


5.66 


3,h 






Common Objectives 


















X 


2.40 


4.00 


2.00 


4.67 


6 09 


5.85 






SD 


1.65 


3.06 


. U5X 


U58 


5.03 


2.19 






Posttest 


















Full Cognitive 


















X 


15.80 


16.75 


9.80 


16.10 


8.30 


23.11 






SD 


7.91 


2. 19 


7.27 


7. H 


5.72 


1.45 






Common Objectives 


















X 


5.00 


15. m 


9..'*)0 


1.1.70 


7..'*)0 


1.1. '.-s 






SD i 


i;5G 


2. 10 


6.98 


5. 14 


4. 66 


1.56 







1 See Table G for descriptions of those jfroups. 
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■ Table 8 

Means and Significance Tests Between Sequences of Booklets for 
Three. Groups with Multiple Booklets 



FuU Cognitive 
Pretest 



Posttes: 



Group 1 
PERT/CPM and CSC 



5a 
Xb 

d.f. 

Xa 
Xb 
t 



Common Objectives 
Pretext 

Xb / 
t 

d.f. 

. ' ' Xb 
t 

d.f. 

Attitude 
Posttest 

. Xb 
t 

d.f. 



PERT/CPM I CSC 



Group 2 
LP and PC 



LP 



Posttest 



2.50 
4.20 
-1.51 
18.00 

19.90 
IS-. 75 
1.09 
16.00 



3.50 
4.00 
-1.31 
18.00 

18.20 
15.13 
1.12 
16.00 



13.30 
11.10 
.76 
18.00 

15.80 
15.38 
.13 
3^^.00 



2.40 
3.00 
"1.00 
18.00 

5.00 
5.25 
-.34 
16.00 



2.11 
2.05 
.28 
15.00 



3.89 
4.67 
-.51 
16.00 

10.30 
16.10 
-1.99 
18.00 



3.89. 
4.67 
-.51 
16.00 

9.50 
.13.70 
-1.86 
18.00 



PC 



2.00 
4.11 
-2.36 
15.00 

9.80 
15.10 
-1.58 
18.00 



2.00 
3.78 
-2.10 
15.00 

9.50 
14.30 
-1.50 
18. 00 

\ 



Group 3 
QT and LPC 



_S3L 



2.31 
1.88 
1.57 
18.00 



10.82 
7.00 
1.85 

22.00 

17.70 
23. 11 
-1.66 
17.00 




6.64 
5.38 
.70 
22. 00 

8.30 
11.44 
-1.44 
17.00 



6>09 
5.31 
.48 
22. 00 

7.50 
10.11 
-1.42 
17.00 



2.14 
1.92 
1.04 
17.00 



J 
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Therefore, the combination of ^oups la and lb, 2a and 2b and 3a and 3b 
Is justified for purposes of furthi&T analysis. 

With the question of sequence effect no longer of concern, we may 
proceed to the results concerning the evaluation questions, The first has'' to 
do with whether or not the DM/DM materials caused learning with respect 
to the c^piitlve objectives. Of ^subsidiary Interest are the similar figures 
for the competitor materials. Table 9 contains these figures. This table - 
presents the mean and standard deviation of the gain from pretest to posttest 
and the correlated t-test for .each of the operations research techniques for 
both the DM/DM materials and their competitors on both the full cognitive 
Instrumeats and the subsets of common objectives. It Is immedlatfely evident 

^ . Table 9 

Mean Gains on Instruments Designed to Measure Achievement 

of Cognitive Objectives for the DM/DM and Competitors Materials 





DM/DM 


Competitor 






SD^ 


t 


d.f. 




SD- 


t 


d.f. 


PERT/CPM 
Full Cognitive 
Common Objectives 


15. 17 
13.50 


7.08 
6.83 


9.09*5' 
8.39* 


17 
17 


10.29 
9.88 


7.94 
7.67 


^ 5.34* 
5.31* 


16 
16 


Linear Programming 
Full Cognitive 
Common Objectives 


8.83 
7.17 


7. 02 
5.25 


5.34* 
5.79* 


17 
17 


4. 25 
3.25 


4.58 
3.84 


3.71* 
3.39* 

c 


15 
15 


Queue I ng Theory 
Full'" Cognitive 
Common Objectives 


11.81 
6.69 


7.98 
4.08 


5.92* 
6.56* 


15 
15 


7.62 
5.46 


4.79 
3^28 


. 5.73* 
6.00* 


12 
12 


Computer Simulation 
Full CognitlV3 
Common Objeotl^s 


3.21 
3.93 


6.55 
2.37 


4.69* 
. 6.21* 


13 
13 


2.d3 
2.39 


6.41 
2.00 


"1.88 
5.06* 


17 
17 



p <: .05 
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that all gains arej)ositive and that all are* significant at the .05 level, with oi 
exception. Under the computer simulation competitor condition, the gain on 
the full cognitive instrument was not significant. Since all the gains are 
positive and almost all of -theln significant, it is evident that both the DM/DM 
materials and their competitors caused statistically significant Increases hi 
performance from pretest to posttest for the cognitive instruments. The 
mean gains for the DM/DM units ranged from 8 to 15. points from pretest 
to posttest. This is a gain of 24% to 45% of the points on the tests. By 
contrast, the competitor gains represented gains of from 8% to 30% of the 
points on the test. * 

The other part of the achlevemeni: question- had to do with attitude 
change as a result of using these materials/ Unfortvinately, a lack of 
foresight In designing the testing situation lead to an Inability to determine 

these results from the field test. It was originally hypothesized by the 
evaluator that the primary attitude change would be effected primarily by 
the first unit that a treatment group studied, and thus attitude changes ' 
could be estimated. If not Identified exactly. Also, since the DM/DM units 
evidenced a ^eater concern for educational problems than their competitors. 
It was hypothesized that these imlts should caii^ a greater change in attitude 
towai^d operations research In education than their competitors. Evidence 
to support these hypotheses should come from the coitlparlson between 
treatment sequences on -the attitude posttest score-. If these hjrpotheses are 
true, »the groups studying the DM/DM units first should demonstrate more 
positive attitudes toward operations research In education than those groups 
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that studied the competitors first. The evidence from Table 8 does not 
support these hypotheses,. Thero were no significant differences between 
the groups using different sequences of the materials on the posttest attitude 
score. Consequently, it is not possible to attribute any attitude to a single 
unit within any of the six groups that studied more than one unit. The only 
two treatments for which this information is avail^jLe are ^'Computer jSimulatioh 
in the DM/DM materials and the queue Ing theory competitor. The mean 
attitude change for the group using '^Computer Simulation'* was not significant 
(mean = -.12,^ S.D. = ,47, t = -.96, d.f. = 12). 

DespUe the fact that it was impossible to derive Information from the 
field test concerning attitude dhange caused by most of the materials, It is • 
not impossible to obtain information eoncerning this evaluation question. 
The pilot ^test can provide some evidence concerning attitude change "caused 
which occurred concurrently with the use of the DM/DM materials. Table 10 
summarizes this information. Due i the scoring procedure for the attitude 

Table 10 . 

. Mean Attitude Change Concerning Operations Research in Education 
from Pilot Testing of Prototype Version 











1 


DM/DM Unit 


N 






t 


PERT/CPM 


12 


-.60 


.86 


-2.40* 


Linear 

Programming 


10 


-.41 


.73 


• -1.78 


Queuelng 
Theo*7:/ 


1.2 


-.26 . 


.93 


- . 96 


Computer 
Simulation 


22 


-.67. 


.81 


-3. 94- 



7-8 
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instrument a negative gain indicates a positive change in attitude. In the 
pilot only two of the four DM/DM units caused a significant change in 
attitude— ^TERT/CPlvr* and ^'Computer Simulation." This evidence is a 
bit contradictory, however, since in the field test '^Computer Simulation" 
was not associated with a significant change In attitude. It would appear 

! 

that the available evidence does not provide a great deal of support for the 
hypothesis that the DM/DM materials change attitudes; however, some 
additional information may be gained by examining the mean attitude scores. 
(See Table 7.) The mean attitude scores of all groups on the pretest ranged 
from 2.09 to 2.58 indicating that before the students studied the materials they 
generally had a positive attitude toward using operations research techniques 
in educational administration (where 1 is strongly agree, 3 is neutral and 5 
is strongly disagree). The posttest attitude scores ranged from 2.31 to 1.88 
which wotild seem to. indicate a slightly more positive p.ttltude, though not 
significantly so in any case. These mean scores Lndicate, however, that 
students still held positive attitudes toward the use of operations research In 
educational adminlstratlcin. It may be iniportant to note the fact, therefore, 
that students still were positLve about operations research techniques after 
using the materials. ' . 

The final statistically tested question in this field study was concerned 
with comparing the DM/DM units with their competitors, both v^ith respect 
to cognitive and affective outcomes. For the reasons stated previously, no 
information was derivable from the field test about the relative changes in 
attitude as a result of using either a DM/DM unit or its competitor; however, 
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considerable information was derivable concerning cognitive learning. 
The first step In analyzing this data was to perform analyses of covariance 
comparing each DM/DM unit with its competitor with respect tfo performance 
on the cognitive uistruments. Table 11 on the next page summarizes chese 
analyses. This table presents analyses both of- the scores on the full 
cognitive instrument and on the subset of common objectives ^for each of the 
operations research tecAmiques. There were significant differences between 
the competitor and DM/DM groups' for PERT, linear programming, and 
Computer simulation; however, the pattern of significant differences was not 
consistent. For '^PERT/CPM'' and its competL^or, the difference between 
the full cognitive scores was significant^ while the difference fpc^common 
objectives was not. For '^Linear Programming'' and its competlto'r the 
opposite was true. Finally,' for ''Coniputer Simulatio^(' and its competitor, 
both differences were significant. ^ 

The meaning of these significant diffei-ences can be more clearly 

understood by considering the adjusted posttest scores for each of the 

> 

experimental conditions. Table 12 contains these means along with a ^ 
summary of the analyses of co^'ariance. The Prst thing that is evident 
from this table Is that in no case does the adjusted mean posttest score 
for the competitor exceed the comparable mean for the DM/DM unit. 
Thus, aU of the significant differences favor the DM/DM units. 

This analysis of the adjusted posttest scores for the DM/DM units 
versus their competitors completes the analyses. In the next section, these 
results will be examined and interpreted in the light of the evaluation 
questions and the conditions of the field test. 
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.Table 11 



. Analyses of Covariance on Cognitive Measures for DM/DM 

and Competitors 

^ I 

* I 



— - y 


r 

Source 


Adjusted 
SB, 


Adjusted 
MS 

^ 


df 


F 


P 


PERt/CPM 
Full Cognitive 


Treatment 
Error 


2^5.97 
1662.61' 


225.97 
^ 51.96 


1 
32 


4.35 


p < ,05 

<»•> 


• 

ConimoQ 
Objectives 


Error 


143, 12 
1495.84 


143 12 


1 

7 32 


3.06 




^*Lliiear Aogrammlng 
Full Cognitive 


Treatment 
Error 


136.65 
1105.41 


/ 

13^' 65 
3^.66 


1 

' 31 


3.83 




Common. 
Objectives 


Treatment 
Errov 


98.42 
642.87 


/98.'42. 
/ 20.74 


1 
31 


4.75 


p < .05 


Queue Ing Tbeoiy 
Full CogaUlv/5 


Treatment 
Error 


96.66 
1114.6 


96.66 
.42.87 


1 
26 


2, 25 ' 


. '.'4 


Coninon 
Objectives 


Treatment 
Error 


8.98 
365. 4? 


€.98 
14.06 . 


1 

26 


0.64 




Computer Simulation 
Pull Cognitive 


Treatment 
Error 


231.17 
1051.41 


231.17 
36.26 . 


1 
29 


6.38 


p < .05 


Common 
Objectives 

L.. 


Treatment r. 
EiTTor 


13.54 
115.61 


18.54 
3,99 


1 
29 


4.65 . 

1 


p < . 05 



Table 12 



Adjusted Posttest Scores on Cognitive Instruments' 
for DM/DM Units and Competitors 







DM/DM 


Competitor 












Adjusted 


Adjusted 


F 


d.f. 








o y 


y 










PERT/CPiM 


<■ 












Full Cognitive 


18. Sp 


13.41 


4.35* 


If 32 






16. 8G \ 


12.80'* 


3.06 


1, 32 






Linear Programming 








1, 3^ ^ 






Full Cognitive 


13. '55 ' 


9.45 


3.83 






Common Objectives 


.11.84 


8.37 " 


4.75* 


1, 31 


o 


v ■ 


QueuelAg Theory 














Full Cognitive 


20.55 


16.86 


2.25 


1, 26 


■J I- 




Common Objectives 


12.16 


- 11.04 


0.^4 V 


~ 1, 26 ^ 


\ 




Computer ^OmilatJon 
Full Cognitive 










t 

' i 




21.05 


15.63 


6.38^,- 


'"l, 29 


, I 




Common Objectives 


C.64 


5.11 


4.65* 


1, 29 

















p < .05 



Conclusions 



The^ajor conclusiouf of the field .test will be discussed and 
interpreted' Ln this section by evaluation questions, with thej^ exception of the . ' 
questions cf side effects of the materials. These s^Lde' effects will^be discussed^ 
in a separate section of. the T-eoliaical Report. ■/^ 
Do the'DM/DIvi moterialis cause significant increase from pretest 



to posttest on tests designed to measure the attainment of irxstrucllonal 



objectives ? - / . 

Yes, ibr all DM/DM units the gain from pretest t6 posttest was ^ 

statistically si^ificant. Moreover, these mcreases in performance^ ranged ' 
from to 45% of the points on the test. It appears, therefore, that studying ^ 



the DM/DM units results Ln increased attainment of the specific instructional 
objectives for those units. Thus, we can conclude that learning is associated 
with studjMng the DM/DM units on operations research in educational 
'administration, • 

Do the DM/DM materials cause sigjiificant positive changes from pretest 

to posttest on a questionnaire designed to measure attitude toward operations 

research Ln education? 

The results are equivocal vv^ih respect to this evaluation question. The 
available evidence indicates that the mai'^rLais changed attitudes toward using 
operations research in only one case. This was for *'T'ERT/CPM'' but it was 
derived from Information obtained in the pilot test. All other available 

Information was either negative or contradictory. Thus, we must conclude 

\ - 

that, in general, using the DM/DM materials did not cause a significant 
chan<^e in atti^^^ude ^Dward using operations research^in educational administration 
There is, however, some additional information that may account for this 
result-- this is, that students responded quite positlvelj- on the pretest 
att'tude questionnaire, so that the stud^^nts apparently entered the treatment 
conditions -/ith a favor ible attitude rather than a negative or neutral 
• attitude. Due to the fabt that this was represented by a raUng of 2 on a 
scale In which 1 represented the most positive attitude, there was not a great 
deal,,of latitude to detect Lmprovemenl In the attitude rating. Therefor^, it 
seems quite logical that there should be no significant improvement ITa attitude 
as measured by the questlomiaire over tie period of the treatment. The best 
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that can conclude is that the iD':^terials did nothing to discourage those who 
used the materials from their oriiT'aal positive attitude toward using operations 
research in educational administration, ^ 
3. Are the statist icall^y adjusted posttest scores on a test designed to measure 

objectives attainment for the DM/DM materials significantly better than those 
of its competitors? 

The results vary with the unit under consideration. The answer is yes 
for "Computer Simulation.*' The answer is no for '*Queueing Theory" and the 
answer is equivocal for "PERT/CPM" and 'Xinear Programming." For 
''Computer Simulation," those using the DM/DM unit performed better than 
those using the competitor both on the full cognitive instrument and on the 
subset of common objectives. This indicates that using "Computer Simulation" 
caused more learning thr^a the competitor regardless of whether or not the 
items concerning the computer were taken into consideration. In the case of 
"Linear Programming," the DTVl/DM unit caused better performance than- the 
competitor on the set of common objectives but not on the full cognitive 
instrument. This result appears rather unusual in light of the experimental 
conditions for this particular set of units. Those conditions were that the UI 
group which studied "Linear Programming" had two weeks to work onXtwo 
units, while the NAU group "which studied the competitor had only one week 
to study the same number of units. Thus, conditions independent of the . 
unit studied should logical!} have had some imp.act favorli, the DM;'DM 
unit. Yet, this proved true for only the common objectives. This, in turn^ 
also contradicts logic since inclueion of items' relating to the computer on 
the full cognU.Lve instrument wou./ argue that If there is any difference 



between the DM/DM unit and its competitor, it should favor the DM/DM 

unit on the full cognitive instrument. THus, for ''Linear Programming'' it 

must be concluded that the results do not conform completely to ^Wgic; 

however, they do favof the DM /DM unit. 

In the case of 'TERT/CPM'' the jresults are much more logical. 

Here the DM/DM unit only caused better performance than the competitor 

on the full cognitive instrument. This conforms with the logic stated in the 

d 

previous paragraph. Fromi these results, it must be concluded tHa*i ''PERT/CPM 
causes better performance than the competitor only when objectives concerning 
the computer are considered. When the more stringent criterion of common 
objectives is applied, the DM/DM unit and its competitor do equally well in ^ 
causing learning. . • 

Finally in thf case of ''Queueing Theory/' the DM/DM unit did not 
appear to perform any better than the competitor under any circumstances. 
In this case, there may be mitigating circumstances which might have 
affected the outcome. "Queueing Theory" was studied by NAU students who 
had only one week to study two units, while its competitor was studied by 
UI students who had one week to study only that uniL Thus, it may be true 
that the performance of the students using the DM/DM unit may have been 
unduly negatively influenced by conditions of the particular treatment other 
than the material? used. That is, the time available for study may have 
had an important effect. Students who had less time to. study the unit ' 
performed more poorly on the test. This, in turn, might account for the 
fact that there were no significant differences between the two materials 

' <•* 
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conditions. It should be noted, however, that under detrimental conditions, 
*- . 

the D^I'DM unit perfomied no worse than its competitor. Therefore, the 
conclusion must be that students who studied ''Queue ing Theor\'" performed 
at least no worse than those studying its competitor, even under detrimental 
conditions. 

It is important to note that both the DM/ DM units and their competitors 
caused learning which was statistically significant and so these conclusions 
cannot be interpreted in the manner of deciding which materials worked and 
which did not. Ratherr they Imply that in several ^ases the DM 'DM xxnltfc 
causC'd greater gnins in knowledge than did their competitors/ 

1 

Summar}^ 

The following statement geneially summarize the conclusion^; of this 
field ttjst. The DM ^DM mntei ials as Individual units did cause learning 
with respect lo using operations research ./m educational administration; 
hov.ever, they generally did not cause a change in attitude toward using 
operations research in educational administration because this attitude on the 
nart of the participants was already X^^^^ favoriiljle. In F:ome •';'xes, the 
DM. DM units caused greater learning with respect to the instructional 
objectives of the DM/DM materials than did their competitors. In those 
cases where t*his was not true, the DM/DM materials caused performance 
at least as good as their competitors. Thus, the DM/DM materials do 
cause leaming/'and th^y sorr.etimes do better, and always no worse, than 
their likely competitors in the educational marketplace. 



Side ^Effects of DM/DM Materials 

All educatlonp.l products cause outcomes that are neither expected nor 

planned for by the developers of that product. That Is, all such products , 

have side effects. An important part of the evaluation of an educational 

product Is the Identification of these side effects, ^cr^ln order to make an - 

effective decision, the decision maker must be a> md able to evaluate 

all the outcomes of his or her decision alternatives., The purpose of this 

section of the summative evaluatio"^ is to identify the side effects associated 

with Data Management & Decision Making. It Is, however, not sufficient to 

merely identify the' :issoc iated side effects. In order to determine the worth 

of the sld^ effects, U is necessary to detei^ine if these side effects are 
< 

^unique to the m.aterials and If these side effects make the materials more 
'worthwhile than their competitors. Consequently, this section will also be 

r 

concemed with how t'^e side effects of the DM/DM m.attM ials compare with 
thos-e of Us competitors. In this section, then, the side effects associated 
with the DM DJVI mai'-rials and their comnetltors will be eniimerated and 
these will Ix? compared In order lo establish the/ relative value of the two 
sets of products in terms of -he .^^ide effects they produce. 

The process ct identifying side effects of an educational product is , 
ofl'M-i facilitated by the attempt to anticipate possibilities that may occur. 
In the case of the DM/ DM^macerials, a number of side effects were 
considered possible. These were anticipated to be concernec'^ primarily 
w^lth attitudes irf two areas- -computer's and operations r'. lijarch in educat^nal 
administration. The following list presents the.-::; ..• ic.pated side effects. 
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1. Increased a\vareness of the utility of computers 

2. Increased confidence In dealing with computers and computer 
personnel 

3. Increased desire to use the computer as a problem solving tool 

4. More negative attitude toward computers due to trouble with 
using the terminal 

5. More -negative attitude toward spec trie techniques due to complicated 
mathematics 

6. Negative attitude toward operations research in educational 
administration due to the concentrated study required 

7. Improved 'problem solving by school rfHtninistrators 

8. More group problem 'solving usirj operations research techniques 

9. Higher incidence of use of operations research techniques In 
problem solving in educational administration 

10. More widespread use of operations reseaich as a course topic in 

^ educari nai adi-iinistration classes at the university level , 

11. Lack of motivation uue to no perceived Lmi: diate use of the 
techaiques 

With this list serving as a starting, point, the attempt was made during' 
the field test to determine If these siclo effects in fact existed and if this list 
was complete. 
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Procedures 

The collection of the data concerning side effects of both the 
DM' DM materials and their competitors took place during the field test of 
the materials. Due to time restrictions involved In the development and 
evaluation contract, only time during and immediately after the test was 
u-ed for this data collection. Hence, it \va6 not possible to . Jlect data 
on all the anticipated side effects of the materials and there may be sidfi^ 

\ 

effects of the materials that were not observed. Only short-term side 

^ 

effects could be observed and no data was available concerning long-term 
effects. 

In order to detect short-term side effects, observations were made 
during the field test, using tvvo separate methods. These were self- report 
by the students and post-session interviews of the Instructors who lead the 

J 

groups. Student self-reports were collected by means of QuestionnairG 3 
.^see page 53 for a descriptions-spec Lfically from responses to questions 
designed to» determine If subjects would recommend the materials they 
studied to others, what they felt were the best and worst things about the 
materials, and their overall reaction to the units they studied. Since the 
e valuator was not able to be on site, approximately one month after the 
conclusion cf the treatments, the instructors who lead the groups were 
interviewed concerning their observations of the field test and were specifically 
questioned on side effects they noticed. In the following section the results 
cf these procedures will be summarized. 



8 9 



80 



Observed Side Effects 



This section v ill be divided into two parts. The first part will 
report the results p:athered from Questionnaire 3 and the second part will 
de:d with the instructors ' observations. 

Student Self-Report. These results are a surrunary of the responses 
jnade by the students to Questionnaire 3. For purposes of reponing, these 
results will be reported by operations research technique. 

The responses for PERT indicated that 609c of those students studying 
**PERT/CP!M'' w'ould recommend the unit to others while the same percentage 
of those studying the competitor would recommend that booklet. There were 
no negative responses for "PERT/CPIvr^ and two or 10% for the competitor. 



items uti Questionnaire 3 revealed very few side effects, from a small number 
of total, responses. Those responses dealing with ''PERT/CPM'' indicated that 
the main side effect concerned the computer. Various st^i^^ts reported the 
computer as being motivating, an exciting learning experience and the best 
thing about the m.aterials. Various student;: ujslng the competitor materials 
reported thai they "got some ^^^reat Ideas on methods of solving problems in a 
back home situation," and that this teclmique would not be much good at tbe 
school principal level. 

The .students that studied "Linear PfograiAming" Indicated that 55% of 
them would recommend the ural to. others while ^15% would not. For the 
ccn^petUor, '41% woiild recommend It wbl'^.e 7% vould not. Remaining percentages 
are accounted for ])y those who did no!_re;spGnd. Various students using the 
DM, DM materials reported that th^y created an warene?? of new administrative 



The rest oi the students gave no response. 
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lC'''hniqi>^'i>> that they will contLnue to work on learning the technique but that 
tb^ technique will probable be of little use at their level. For the 
compel Ltor the student reports revealed such side effects (in the responses 
of individual students) as providing potential for all types of management 
problems, creating the opinion that operations research techniques should be 
m^^luded in doctoral programs, and the opinion that the materials give confidence 
and knowledge for future use — 'lessens the unknown." 

The response;^ on Questionnaire 3 for the groups using the queueing 
theory materials revealed that 60^ of those using ;'Queueing Theory'' would 
recommend the materials to others while 53^ of those using the competitior 
yjex^ of the same opinion. The rest of the students did not respond. The 
predominant reported side effects for "Queueing Theory-" had to do with the 
coii^puter. Various students Indicated that the materials made them aware 
of ^^he manifold uses of the computer, increased their confidence with respect 
to Computers, and w^ere a good Introduction to the computer and the services 
U Can provide. Several students reported that the materials gave them a 
new outlook on administrative problems. A negative side effect appeared to 
bt? the perceived lack of relevancy ef queueing theor}^ The only side effect 
r^^Porfed for the competitor was the opinion of one person that the technique 
should be emphasized more in educati )nal administration courses. 

For computer simulation, the rate of recommendation was also fairly 
hlgJl, Seventy-five percent of the students who use "Computer Simulation" 
\vouid recommend the materials to others, while 45^r: of those using- the / 



onipetitor would. The rates of nen::Uivc recommendation were Cfr and 
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rC'S^^jctively. With rospect to the side effects of the DM/DM materials, 
several students reported that the best thing about the materials was the 
computer, :ind :bat they felt nu>re confident in dealir^^ with it. One 
student reported that he planned to use the enrollment ^rojecLion simulation 
in his o\%'n school district, and two students indicated that they were anxious 
to read the other materials. In the competitor condition, two students 
reported that the materials %ave the. i a now perspective and that It appeared 
to be a highly usable technique; hov/ever-, cdveral others expressed frustration 
with the materials, 4 

This completes the description of the results of Questionnaire 3 with 
respect to side effects. As should be evident, there were only a very few 
responses which Indicated prevalent side effects, and not many students 
responded to the questions. There may be several reasons for this, including 
the fact that the students completed the questionnaire immediately after taking 
a posttest over the materials they studied and that they often had to fill out 
two identical forms over th^fi two uni^ that they had studied. The paucity of 
•responses generally would seem to indicate twoUhings, " 'rst, that tl^ 
students were frustrated with all the testing, and vented this frustration by 
refusing to respond to Questionnaire 3, ^ And second, filling out th' question- 
naire almost LnimediatelX after finishing the materials did *not give the 



time to form definite opinions. Thus, there appear to be very fgw reported 
side effects of the materials. The best that can be said is that for the 
DM/ DM materials there w. 3 a consistent side effect having to do with the 




students the opportunity to develop a perspective on the materials— and the 



computer as a problem so^vLns; tool and as a fascinating mac'iltie. 

IniFtruccor Obfe rvation . The persons interviewed for the purposes 
of identifying side effect.s were those pi'incipally responsible for impleinentation 
of the field test at each test site. The side effects "that they observed 
focused on two primary' positive concerns having to do with the computer 
i:nd continued interest in the materials. 

The side effects having to do \vLth computers appeared to be most 
predominant at UL The principal instructor reported obser\nng the following 
side effects- 

1. Students gained an Impr^^ion of the po%yer and utility of the 
computer. 

m 

2. Students learned 'o use and deal with the ' omputer as a tooL 

3. Most of the students wanted the materials that dealt with 
the computer. 

4. Students e:-rperLenceci -or: \;tratLon with using the computer. 
These side effects were delected by discussions \yith the students anc 
observallcn cf the ir woi^k at the terminals. 

rhls instructor also observed several side effects having to do with 
the DM/DM materials themselves. A r/ mber of students (the exact number 
was not specified) asked the principal instructor for other materials that 
they could study on a voluntary ba--*^. In evorj^ c*ise» these materials were 
the DM/DM materials. Evidence of this continued inter^ot was also ftJund 
in that students are --till using the computer programs which accompanied 



the materials approximately one and me-half months after the completion 
of the field test. Another side effect was observed in another course that 
this person was teaching. A requirement for this course was that each 
student do a project In educational administration using the computer. 
Twelve to eighteen members of this class reported that they were using 
one of the operations research techniques that they had studied dv - : ig the 
field test — primarily PERT, linear nro^amming and computer simuliition. 
The majorit>^ of these students were using P'^RT and its associated 
computer program. A specif i side effect of "Computer Simulation" was 
also reported in that two students indicated to the instructor that they had 
used one of the simulation pro-ams to solve prd^ams w their own districts 
As should be evident, the instructor had some difficulty in attributing the 
various side effects to the specific units, but the overall outcome at this 
test sire would seem indicate that there were many more obser^'able side 
effects for the DM^DM materials than th^e;c^ were for their competitors. 

At the NAU test site, a smaller number 6f side effects were reported 
and there appeared to be more aegative ones. It is important to note that 
at this test ^Ite only 'Queueing Theory** and the linear programming 
competitor were used. At this site there were also reported several side 
effects having to do with computers. The instructor observed that: 

1. The students learned to use the computer as a problem solving 
tool. 

2. The students appeared to be more confident about using the , 
i )mputer aP^^r going hrou^ the materials. • . 
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.1. Students expressed a desire for additional use of the 

computer beyond that required, 
t. Stizdenis expressed a desire to use the computer in othei^ 

classes, 

5, Students were sometimes fru.-'rated In using the computer 
terminals. 

l: nce rhe DM/DiM unit "Queue ing Theory" was the unit that used the computer? 
it Is losfu ,1 to attribute these side effects to th'^t unit. 

r 

With respect to the unitS themselves, several side effects were also 
observed. A small number of students (three) requested to go through the 
other DM/DM materials^n a voluntary basis. Several students also suggested 
that the D^I/DM materials be made the basis of a course in educational 
ad^r * ustratlon. On the other hand, some students, exp essed the opinion that 
they were "more at home'* with the linear programming compuiitor, since tl 
had confidence that wher. they made a mistake Lt was their fault, in contrast 
to the possibility of computer difficulty with the DM/DM materi; A 
negauve side effect that was observ^ed for both units was chat many pi^ctic'-^^g 
administrators did not complete the materials. They riipoited that they had 
more press^ing obligations, but the instructor interpreted this as a perceived 
lack of relevance of the materials; this, however, was not attributable to one 
^. r ^he other of the units studied. 

Conclusions 



^ ' Before c! conclusions from this study it Is important to take 

note- of several l nditiolis that limit tho ''zabllity of these results. The 



> 

first hixs io do with the computer side effects at UI. The program within 
which this field tesf cook place at UI has had for some time a definite , 
pof itiw orienration toward the use of computers in education. In fact^ the 
Driiicipal instructor r-.t this test site Is considered to be an expert^in the 
area of compiiter applications in educational administration. Therefore, 
there is the possibility of ^ posltiv? bias toward computers in the- 
Instructional environment and it fs possible the stud^^its^^have absorbed 
tome of this bias. In addition,- there might be some bias on the - ^ of 
.lie observer, since he lu strongly committed to the use of computers and 
operations research in education. The evaluator was aw^are of this possible 
source of bias and he attempted to structure the interview so that evidence 
opposed o this bias might be brought out; however, the conclusions 
concerning the side effects as reported at this test site must be tempered 
by this l-mowlcKige,/^ 

Inking this knowledge into account, it. is still possible to conclude 
,chat the primarv^ side effects of the DM/DM materials have to do with the 
computer, .^ince there Is confirming ev^^^ence from another LOot site. It 
would appear that :he foLiowing are beneficial side effects of using the 
DM/ DIM materials. 

1. Studems learn to use and deal with 'he computer as a * 
problem scl-'ing rooL 

2. Ptudeats gui-v confidence in using the computer ?s a result 
of using the maierials, 

3. Students desire atidili(j;^al usage or e.kperience with the computer. 
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4.. Students find the use of the computer to be a motivating 

experience. * • • 

^ . ' ^ ' . ' , \ . • . " 

On the other hand, the^re is also a negative side "effect associated with" the 

DM/DM materials In that students becpme somewhat frustrated Ln using ^e 

.computer Iterminr.'^, =, . v 

cV There appear also to be two Important positive slde^cfffects'^of the 

DM/DM materials themselves. First, they' are Interesting ^and relevant 

enough tftat majorities of persons using the, unitSsWould rec6inmend them .to ' 

others. Second, tjiey appear to be sufficiently Interesting^ so that many student^ 



wlH' 



desire to, learn more about other operations researcl\-'technlques. A major 



negative side effect Is that students often experfence a sense of, frustration with 
the materials which was apparently due to a number of sources, but )whlch»was 
in evidence for all units f^' , • ' 

» Some side effects were also reported foj the cofnpetltors;-however, ^ 
most cases, these were essentially duplicates of the 'side effects of' the ISVI/DM 
materials, excluding computer^.. Students reported that the competltors/for 
"PERT/CPM" and 'T^inear PtQgrammlng'^|Jrovlded ne;v Insists' concermlng 



the problems of^ the educational administrator. The one xJlfferent side effect 

' ' • i , ■ - 

was noted at NAU fop the linear programming competitor' in that students 

felt quite ^^comfortable'* with Vthe^ materials. ^ . - ' 

• ^In comparlng-the two ^ts of matei^lals with respect to side effects, 

■ • " • . ... ' / • ■ 

one result ls> particularly evident. , ,/liie DM/DM materials are associated ^ 

\. ■ ^ - . . ^ ^ . " ' • * ' ■ • ' ' ' , ■ 

•'with, a number" of side e fife ctis concerning computers that the competitors*^ 

simply do not have. In addition, the DM/dm ipaaterlkls gene rallyj evidence 



; to a \rir,r,^ 'greater extent the side effect 'of motivatidn to go beyond the 

givfen *material to search out new ideas In ^oper at ion^? research. K is also 
^ 'true, however, that DM/DM materials demonstrated more negative side 
^.effects than their ciympetitors,, thou^ these did not appear to be major 
sfactors In using the materials. Thu?, it is reasonable to conclude that the 
. DM/DM m^erials have more s^e, effects than their competitors and* that these 
side effects are generally positiye. * • : • 

^ Costs, and Benefits of Data Management & Decision Making 
jjjjpp. This analysis of the costs and benefits 'c^ the Data Management & 
Decision Making materials is designed to provide /information as to the costs 
to potential users pf the -DM/DM materials and how these costs compare with 
the benefits derivable from us[ng the materials. The analysis will also speak 
to the^^txmcem.of how the gosis and\benefits of the DM/DM materials compare 
. with -those of their competitors. The focus of the analysis \ylll thus be on 
th]?ee major questions, . ^ * • - . ' 

1\ What are the costs of using the Data Management Decisioif ) 
. . Making materials? 



2. What are the benefits o£ using the Dafea Managem^n^ & Decision 
/< Making ' mater lals ? - ^ ^ , ' 

3. How do the/c^ts and benefits* of the J3M/DM mateVlal©' compare 
to the^ costs'and benefits of using Ihelr competitors? 



In order tor accomplish this analysis of.co^s and benefits, several 
tasks must be accomplished, It Is necessary to'defme >vliat is meant by costs 
and*'^yhat is. meant by benefits and what units of. measure are appropriate, fot 

these outcomes. Source a of costs must be identified and the estimated costs 

fc ■ * " ■ ' ■ * 

in the given unitW determined. Benefits must be deterniined. ' And finally, 
the developed product and their competitors must be compared a|[& conclusions 
'drawn with respect to 'their relative cost-effectiveness. *In the following 
sections each of those tasks will be addressed. • \ 

Costs - * ... 

. In this section, th?' costs of using the DM/DM materials^ will b^ 
examined as will the costs of using their competitors. First', however, the 
concept with which the sec ticqj. deals must be defined. Fisher (1971) defifiies 
costs as benefits lost. That is, the costs of particular, decisions* ard, in 
the broadest sense,' thp benefits which mi^t of fiave been gained lDy choosing"^ 



other alternatives, but are lost by choosing' this particular alternative; The 

> . • / - J .. 

question immediately arises, however, of how these costs can be measured. 
One such measure of th^se costs is ,to determine the resources that muat be 
allocated in order to implement a decision alternative. An infportant measure' 

" ' . ■ ^ • . • • V- ^ ■ > . 

of these resources is thevmonetary value of flies'fe resoi:^ces — the dollar,. 

In this analysis, the unit of nieasur- will bcvthe dollar* Yet,, this, is 

« ■ , ' ■ ' ■ -I 

not ,a perfect measure. It provides a poor measure of m^ny 6f the intangible 
costs df k decision altemafalve, .for how are -such iiripartant aspects of decisibn 
alternatives as staff morale quantified -in dollar terms. In spite of its 
inability to >repres.ent all costs dJf a partipular decision alternative, dollar * ' 

costs are of great -concern to many decision. makers Hjiolud/uig, .those Ip, 

^ « / . . • "90 



education. And thus, it will provide information of considerable .iise to ' 
the decision maker^ ^ i _ ' 

?TH^,^^termihLng the costs of using instructional materials su^h as the 
. * - * 

DM/DM mateijials/ the first step is to identify the, sources of costs which are 

inv^ed. For the purposes of this analysis A these costs are subdivided **Into. 

the areas of imidedtate costs, second^^ry cogts and opportunity costs. 

Immediate "costs are' those costs^for which the decision maker m^ist 

' ■ . ~ - • . <^ ^ 

i)udget when choosing to use the materials. Th^se are 'the resources ^hat - ' ' 
must be imme(|iately allocated in ordei^ to use the instruct ional materials. 
Such cosife include the C9fet of the instructional materials themselves. If the ' 
materials are^to 'be ys^tp in a course or workshop setting, an instructor and 
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all his associafed costs iniist be considered. Cost of setting up and arranging 
for the. workshop must be; included. Personnermay have to be coi^ensate(|^ 

for their time spent in studying the materials. If a computer Ls required, ' 

: . ' ' . * • ■ ' ■ \ 

the:^e wiU be the costs ot computer time and equipment costs. .Resoi|rces . 



must be allocated -to provide facilities ^for a workshop and if 'imiverfeity 
credit is to be given the cast's of arranging for it must be included. 



* Potential secondary costs ^re those 'costs which may result' iftdirect^y . 
^ from using the instructional materials. - *In this -case, the identification of cost 
SQurces is based on. the assvimption that a decision has-been made, to use one / 
of the techniques described in the r&aterials to solve a problem in^educationa^ 
administration,- as a result of studying the materials. In this case, the sources 
of secondary ^Cftgts be a result bf^ttenlptiiig to implement the tethftique. 

^ i * ^ V . ^ , \ *^ * / 

Possible ^soiJ^ces incl>ide consultants <iwh mi^t be necessary 'to hnplement 



the finer points of the technique. Since all these techiiiques are based 
on analysis of data, an important «)urce of cost will bd the gathering 
of the ^necessary data. -Algo, since most of thSse operations research 
techniqiies require a coniputer, 'there may be costs for^ computer services. 
Finally, since personnel will be required 'to perform, the tasks of solving 
the problem,' it is necessary to coneidey ttfe cost^ of usiftg those personnel. 

The final category of Cost sources — opportimity costs — represent all , 

* • " .■ ■ ' . 

"benefits lost" which have 'not been included in" the previous categories. 

That is,' these cqsts represent benefits lost by not lAaking decisions other* 

• ' - »* 

than those to use the materialf5. This is essentially a category- with an ^ 
infinite- number of cost sources ^since there are always an infinite number (}f 
'po^ible decision alternatives. With respect tp these 'mateiials> 'however, 

there, are. two major sources^ . The first is the (^)porturiity .costs of training 

^ . ■ " '■ ' * • . • ' 

injDther adrainistrative probleiji-solvlrig techniques* other thaiii tlje foUr 

presented in these materials^ The second of these are the benefits lost of 

■ • ■ ' • . - ^ • - ^ A 

the personnel in trgjning who are not^ performing theii; normal work 
assigrmients. ' Tjjie.se a^e but two of' the possible sQUi^ces of opportunity costs 
but they rnay be*of the most iigrri^diate importance in making, decisions 
GoKcerping the use o^ the DM/DM materials. - , ' ^ . 

* ' • Xfter identifying th^^ potential^ s,our5es of costs in usiag the^^HRexials, 

. v" , ' - ■ ' > y:^.- 

th(2 nixt step' is to estimate tffe jnagnitude of those costs. In tke following 
'. ■^ " • • . \ ^ • > ^ .'• ■ " V .V 

paragraphs-, the^ co'sts eminating from the sources previously identified will^ 

bfv estimated. * . , - , . • 




Materials > .The cost of the inaterials was assumed to be their 

purchase pirLce* "For the DM/DM mater Lais, Lt was ass\nned that they were 

published as a single, 450 page, hardbound text by *a commercial ^ILshhig 

company/ The resultLng cost as estimated by the NWREL Offlfce of' * 

Dissemination was $12. Since the competitors were separate units of : » 

materials, their costs were estiynated separately from their purchase . * 

... 

.•■ ' * ■ - - . - - - ' ' 

prices. For the PERT competitor the cost was $7, for the linear programming 

competitor, it. was $25. The queue ing theory ^competitor was available only 

as part of a text which- costs $8.50- and the. computer simulation competitor- 

"In.text foriit costs $4.95. Thus the cost of a set of competitors ffor the 

DM/DM materials totaled $45.45. - - 

Iifstructoy^.^ For purposes of determining costs, it was assumed that 

• ; ^ . c • . ^ ^ i- 

the instructor for any workshop or course would be a university or college 

faculty member in educational administration. For- a workshop it wsts 

assumed that this person^ would charge a fee of $200 per dsty^or instructional 

session. Ijr addition, travel expense would »have to be paid. ^ For this it was 

assumed tha^an mstrjictor would be available within • 200 m'lles of the workshop 

• .» • " ^ . » ' 

site. Thus, .travel-^eimbursejneht was estunated at 15^ per mile for a 400- 
' * *- " ^ ^ '* ' * 1 ■ . * 

mile round-trip, or $60 per .trip. • If . the materials were used in a' university " 

' : . . ^ - . . 

class,* there \voulrf bejio* additional expenses for the ^instructor that would not 

be\a'rt of his salary *tror^ the institution. It should be noted that these 

* . ■ . 

exp^tises would not depend on whe^er the, DM/DM .materials or their rcbmpet iters. \\ 

wc ;<5 used. ^ ^ • , . / ^ 



Class Setup, Costs -for class setup in using the DM/EM materials 

would depend^ on whether it was a workshop or a fiollege cla33. '* For a 

college class, there woul<i be no additional e;q)ense in usin^ the, DM/DM 

materials since the untvefsity provides this service regardless of the 

instructional content of the course. If -the situation were a workshop/ it - 

mi^t be necessary to, install telephones for communicating witli the computer 

(estimated by Pacific Northwest Bell, total at $30 per phone)- and there wbuld 

also be operating costs for the wo^rkshop such as lunches, 'coffee, and^ so 

forth (estimated at approximately $3 per person per day). Finally, v ftiere y ' 

* » ' * * 

would be .miscellaneous costs which, for- the purposes of this analysis,* are 

estimated at $50 for a four-day workshop. 

Personnel Reimburi^ment. If .the use Js in a college class, this* cost 

will be nothing, since the university .-does not reiroburse students for- their 

time. If the use is m a workshop for practicing administrators, howevfer, 

there may be a number of cogfcs such as per dlem^^nd travel. 'An estuAated 

figure for per diem is $20 per day, thou^ many school'^ districts may not 

pajf^'pef diem at all. v If travel expenses are re'imbursed, ^it Is Vssumed that 

th^ p&rtfcipd:nt must make no mpre than a 400-mile round-trip at 15< per mile 
• . . . ■ • ' * 

or $6Q per participant. Group travel -would mafc^ this figure less.* 

, Computer Terminals. ^Since a comptiter tetrilinal is a vital component . 
cdf 'DM/m^ iiis truest ippal system, additional costs will tie incurred when using? 
'Vhesc materials, vlf the Institution which is spon^pring the instructiohal ' ' a 
session already owns and operates the terminals, the ^osts for the teVminal^ 
themselves will be negligible; however^ ' if the terminals must be leased, fhe . 



oosts, will be of decern. AssumLng that thp cheapest terminal avallable» 

a .teletypewriter, is leased only for the fiine needed, it is estimated that . - 

• the costs would be ^$5 per ^day per terminal. 

Computer Time. , Since the DM/DM materials require the use of the 
computer, some e^q)enses for computer time wiU be^curred. " Evidence 
from the pilot and field testing indicates that each- parti^cipant would use 
approximately two hours of terminal tune and five minutes of CPU time to 
work throu^ all of the computer exercises. The literature 
indicates ifiat terminal time generally costs between $4 and $9 per hou? and 
thus .the cost of terminal usage for each'.participant would be $8 to $18, ,if 
all the DM/DM units were studied. This same literature Indicates that the 

-CPU time required would cost, from $1 to $6 per participant. 

X^.Qllege Credit. In fhe case that the materials were used as a part 

of a college course, there would be no additional/ cost to the students and * 

» ■* * ' i ■ ' 

college /beyond the usual gosts of the course, '^he situation v/cujd be dif^er^nt 

if college credit were arranged for a workshop. In this case, the cooperating 

college would most likely charge a fee for granting credit. Since a four 

day, workshop clover in^ all the imits would be t^^equ ivalent of threfe credit 

. ^.course in terms of cla^s PIme, the charge wouM most likely.be for granting 

, three credit hours. A pall of local colleges and universities indicated that 

... ^ - . ^ ■ 

%the charge. is about >$30 per participant per credit hour ot.$90 for three 

• • <■ ■ - ' - / . / ' 

credits.- • ^ ^ . 



» ' ' ' ' . 

FacQltles. Since some type of facility will be required for any 
group use of *the materials, some facQities costs may be incurred. In the 

* ' ^ •■'5.' 

case of a college coiij^^e, there will agairi be no additional costs beyond those 
incurred by the course as a whole. If a commercial facility is used fcJr a 
workshop gjpoup of approximately 15 participants, it will cost in the, range from 
$20 to $50 per day. Use, of a university or college facility mi^ fall 
in the' range of $5 to $12 per day for comparable fecilities, and use of 
school facilities of comparable quality would cost $25 per ddy. ' ' 



The direct, costs of using eithex the DM/DM materials or their 
competitors are fairly easy to estimate; however, the estiyiation of Jhe - 
secondary costs is much more difficult due to their lack of definition and'' 
clarity. In tl^e next few paragraphs some cost estimates v^lll b^ given and 
types of costs identifie'i, though these may vary grfeatly from the stated 
figures. ' ' ^ . ^ ^ ... 

Consultants > Since consultants are usually employed by. the day this'" 

• ! ^ ■' ■ - . ■■ " • 

costs may be esCirndted on a per daj^- basis. It is'asstime^ that for most of - 

the, work a college or university faculty memb'et can perfonri the consultariit 

> • - ■ • 

• ■ . . . 

woric; A common * consulting fee charge by indiviiduals of this type Is $100, 

. " ' *' * * ^ 

* » . " ' . '%> 

y per day; however, estimates of total consulting posts cannot be estimated. - 

. precisely, since the number of consulting days required 9epends wholly .on 

. . • - ' . " ■ ' - , ■ / 

the complexity of the problem and the typesj of attempted, solutions. 



Computer, It Is also impossible to give any meaningful estimate 
for this cost for a number of reasons, tt depends once again on the scope 
and complexity of the problem under consideration, Vthe type of computer 
available, and the skills of the persojie using the computer. 

Personnel, This also depends on the same factors as px the previous 

categories of costs. The most that can be said -is that this will be generally 

an important category of costs in solving problems using oper^ions research 

techniques, . - ' ' 

< ■ 

Data Gathering, As with all previous categories, ' these costs are 

hi^y variable depending on the scope ,&d complexity of the pr emblem. In 

i - ' ■ ^ 

addition to the availability of data. The most that can be said for this 

] . , . ' , * » , . 

category is that this wlU generally be an important non-zero e;q)ense which 

_ I _ • - V * ■ ■ ' 

will inchide^ at a minimum* costs for clerlcarpersonnel and kejrpvmching. 

^ • - ^ 

* ■ 

^The estimation of opportunity costs Is equally as difficult as' was 
estimating the secbndary costs of u.ilhg the materials. In only Vthe very . 
fewest cases is it possible to put dollar figures on the costs incurred;, 
however, in the following paragraphs 'an attempt will be made to dlscusf^* 
itese cost sources ^ ... 

; * " Normal Work, In training practicing admilnlstrators, there will • '.^ 
always be- a' cost due to delaying or ilbt Qompletlng the normal work done 
by the ^participants. This may be estimated by determining what the cost 
to' the school district. Is for having normal* work accomplished and .Identifying 



this as the benefit lost. An estimate of the average hourly salary of a" 
practicing administrator is $11.30 (Project FACT. 1973-1974) with aadition of 
15^ for benefits, the total comes to $13 as the average hourly jvorth of an 
administrator. If the administrator spends ei^ hours studyli^ a unit 
-.instead of working on district business, it ^ ill cost . the district approximately 
3104 in benefits lost. For a four-day workshop, thi^ would amoimt to $416 
in opportunity costs to 'a district for each participating administratoi:. 

Other Training, Again, costs incurred in this category are benefits 
lost by not acquiring training in other problejn solving techniques or any other 
training* In ordei: to estimate this type of cost it is necessary to specify 
the possible decision alternatives (other trainuig>*and estimate the benefits 
from each of thes.e. What little information there is -on this subject does 
not relate to training educational administrators. Thus, the most that can be 
said is that this will be a cost, but its magnitude is not possible 'to estimate 
in dollar terms. ' . . 

Comparing the DM /DM Materials Costs with tho s e of its Competitors 
As" should be evident from tne description 9f the alternate use of the Dfil/DM 

^materials, It is not possible to arrive at a single estbnate of the costs for 

* *' < 

using the materials.- Nevertheless, it Is useful to determine tlie costs of 

• . ' . - ' ' .1 

using the materials under a specific set of conditions and compare it with /the 
costs for using its competitors. In tnls way. It Is possible to obtain an 
estimate of the relative costs of using the DM/DM or Its competitors. 
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/ Fijrst, let us assume a most e^ipensive case« Here we \yili.coii|idir 
onfy the immediate costs since those will probably be of primary cottcem to 

V 

most decision makers Assume that this decision maker will be responsible 
for all costs. Further, asstime that there will be a vyorfishop of , 15 

educational administrators in a workshop of four days in duration which will 

- y 

t^ike place at a local commercial facility. The workshop will require an 

Instructor who is a college or university faculty ^ember who must travel 

200 miles, ft will also be necessary to assume that all terminals must 

be rented and that commercial computer services must be purchased.. 

Table 13 presents the estunated costs for this workshop using either 

the^ mi/DM materials or their comp.'jtitors. It is immediately evident from ' 

\ Table 13 

Costs of Usmg T)ata Management & Decision Making 
• or Competitors In High Cost Situation 





S9urce 


DM/PM 


Competitor 




• Materials 
Inst motor 
Fee 

Travel " 




S 180 

800 
60 


$ 682 

800 
60 




* • • 

Class Pe^.up 
, Telephone 
Miscellaneous 
Operating Costs 


\ ■ 


120 
50 
180 


. so" / 

ISO 


t 


Computer 

Temlnals [f) 

Time 

Connect Time 
CPU Time 


\ 


80 

208 
160 






F&cilitieG 




120 


120 




Immediate C:ost Subtotal 




$1,958 


$1,892 




Oppoitunlty Cost * 
Personnel Time ' j 




1,560 


' "l,5G0 




Total ^ / 




$3,518 


■ -$3,451 



the 'table that, the total costs in this situation are e;ssentl)ally the^ same, 
'differing by less ,than $100. This Is preliminary evidence that there is no 
cost advantage in using either the DM/DlVf mpterl.als or their competitors, 

in this sj:tuatiohJ • ' . ' ; ' 

'f ' - 
* Ift order to gain additional ^'r.f^^^ , eiatiVe , costs of the 

o ■ , .. . 

two sets of -materials, let , us also coi»i|pi IIIl- iBgst expensive case. Here 

it Is .assuined that ^a "single administrator Is stfidylng the 'materials on his 

» ■ ■ . ■ 

own time. The district pays only for tbe materials and the computer time 

used on m^bhineiy that the district owns. Table 14 contains a comparison 

of the costs fo-r the two sets of materials.. Again, the difference between 

the two sets of materials. Is quite small, indicating that in'thls condition 

there is essentially no cost difference between using *the DM/DM materials , 

or Mieir competitors. ■ . . . • 

: ' Table 14 ^ \ 

' Costs of Using Data Management & Decision Making 
or . Competitors in Low Cost Situation " ' 



... . . ^ . • 
Source ' . . 

< -.. . ' ■ « ■ 


DM/DM 


Competitor 


Direct Coats 






Materials 
- Compute^: - ^ 
, Terminals (.65 ftrs.) 


$12 
3 


..$45 

, • . " p 


Direct Subto^l / 




45 ' ' ■ 


Opportunity Co^s 
Personnel x 








Total . ^ 




^$41 


$45- 



\^ ' FuVther perusal ojf^the two comparisons reveals the ^reason for the * 

iack"''pf>>differ$We m costs between the two sets of materials. Nqte that; In 



/ 
/ 



materials costs, the- competitor greatly exceeds the DM/DM materials.^'- ' 

However, it should "also be , noted that the .competitors liequlre no use oi th& 

- ^ / ■ ■ ■ ' . • ■ ^ . 

computer, so^hat usmg the computer witti thfe DM/DM rnaterlals incurs. ' 

additio^ial expenses. These expenses IMdsi^t anc^iM^r out, so that .tfie 

oVeraU^ expenses^. will come ctxt essentiaily even under most circuinVtancei^ * 

>The^xlnvestigation- pf. the relative costs -of the DM/DM n^terials a{id 

;theif ^cbmpetitdrs has i^evealed ^ao Advantage for one or the >otherv but this 

d^6s riot mean that there are no differences,, There, may be differences in- 

benefits derived for 4:he same cost.. ' ). 

Benefits ' - V . 

\ -Benefits are the '*good" or' desirable outcomes of choosing a particular 

decisuDn al(ternative, , The problem with determining WnefitV is .tha^t outcomes 

vary in desirability for different decision makers. • For the purpose of .-this 

analysis, an assumption must be made. Here the assumpbiori will made 

that a benefit of ^n instructional program is the attainment of one of the goals / 

• of ^instruction^ We will also assume tljat evidence ^lx*eady exists^ that 

•I 

attainment of^these goals is desirable by some target population. In fact, j 
thW evidence does exist for the goal of the DM/DM materials in the -results 

■ - ' . .... . ■ ■ . . • ■' - ■ -■ ^ •. 

of the need^- assessment. /Thus, comparing benefits becomes g^nei^ally the 

. ^ ^ • ■ / J 

task of comparing: goals of the materials. 

The first task in considering benefits then, is to enumerate the. goals - 
of the materials. To summarize , the section of this report describing the 



DM/DM materials, the goals will be briefly listed. , Th^ overall goal-o^ the ^ 

materials Is to "ereate an avvaren&ss of operhtidns research tec-hnlquestin 

.. ; % _ ^ • • * ^ * ■ ' . . 

^educational 'administratqrsr 'Within this mSln goal are the following subsidiary* 

. . , , • . ^ - . . 

goajs.r .-v " • ' I * <»v i 

• ^'i. • . , ■■ - •■ 

jL. Acquisition of the vocabulary of each technique * , . 

■V ■ • ' ' •■ 

2V; Development of somr r^Qity with the specifics of each of the 
fo^r techniques f ' ' ' ^ 

,3, Acquisition of knowieu|j, on how to use the computer as a . 
problem, solving tool, with respect to the four techniques - 
4. ' Development of the a^ilSy^ to "determine appropriate uses^f * 
each of the techniques In ediicational administration : 
. 5^ Developmeht' of the ability ,tt) make decisions based^on the 
^ results of using each of the techniques > 
/ U6. Creation of a more positive attitude toward operations research 

* * ' ' ■ .1 ; - ■ 

. r^^^ in education ^ - _ 

Since the competitors were chosen to reflect es/sfintially the 'same goals .as 

' ^ .. ■ . 

the DM/DM materials, this list substantially represents the goals of the* 

competitor materials as well. " * - 

In order to make the most rigorous c ompar Is oii. between the costs 

and benefits for each of- the sets *qi materials, it is necessary to quantif}^ * 

these ^benefits ;in dollar terms. This quantification, however, is extremely 

difficult if not impossible. First, accgmpllshing the g^als only provide- the 

potential for better problem solving in educational administration, and this 

potential m realizable -in a great, number of ways. In, turn each of these^ 



ways Implies benefits In^doUar terms such as cost savings depending almost 

■ - ■ . ■' ■ ' ^ ^ ' 

entirely on the Individual sltuatioDir Theoretically, It should be pos'slblO' 

to determine an average dollar tteneflt by observing a gjreat' number of 

"* ' * • • 'i " * 

situations kn which these techniques are used; however, no such evl^enb^iet;^^ * 

• " » * ■■ • • * * 

presently exists and It Is beyond the » scope- of this evaluation to carry gut ' 

those observations. • IJius the best that can be, done In examining the beneflfts 

of these sets of materialR la thlstf evaluation Is to eauji'ierato chelr benefits * 



and leave it to uue declsloii maker to -dec Id© the relarttlve Impbrtar^c^^ of 
these*^ benefits. 

In 'comparing the benefits of the two set's of materials It seeix\s mpst 
obvious to compare the goals th^y'.apparently. profess. Table 15 summarizes 

this comparison. , This table shQws that tl a* DM/DM material's profess three / 

• . .. 

^ , - ^ 

more Important goals than their competitors, with the exception of linear ' " ^ 

^ ' ' • • ' " • - ' \ ' - ■ ' ■ - ■ "^ "^^^ 

, programming. Of these, th^ere was evldeac.e In the field test that tavo were 

accpmpllshed or at least partially- attained. The DM/DM; materials did not ^ 

appear to change attitudes;, consequently,, while this goal .was professed, it 

y ■ ' - ' . ■ . ' ^ • ."■ ^ ■ ■: ; 

was 'not attained. In sum, it would appear that the DM/DM materials have 1 

' ^ ■ . — ■ ' . ■ " • ■ ■ ■ 

two benefits that the competitors do not have relating 'tp computer usage and . 
problem Identification In educational administration." ; ' 

■ ' ■ • .. . • ■ / - 

■ \ • < . /f 

It shoiild'be noted that thl^ treatment ot the benefits of the DM/DM * 

materlgils and their competitors took place at a venK. general level. ' There 

may be specific goals of either th^e DM/DM materlals-/or their competitors / 

.. : . . ■ . ■ ' ■ - '-^7 . ■ .'^ ■/.( 

which were not taken Into accouhit-ln this analysis. On the whole, howeveif. 



Comparison of- Appa^nt Goals of DM/DM and Competitors 



; , \ — 1 — " 

^ Goal / 

•V >v . 


DM/DM 


Competitor 


1. Create an awarehes^ of operations 
research techniques In educational 
administrators. » 


Yes 


> Yes 


2. Acquisition of the vocabulary of 
each technique \- . . 


' •Yes 


Yes 


3. Developmenl pf some iaouity with the 
specifics of each of the four techniques 


Yes 

i 




4. ^'Acquisition of knowledge on ho^ to \ 
, Use the co];nputer as a problem- 
solving tool with respect to 'the 
^^^technlques V ^ 


Yes 


No (3) 
Yes (1) 

• 


5. Development of die ability to 

determine appropriate uses of laach 
of the techntqii^ In educational 
administration 


Yes 

• 

■ \ 


.-No . 


6. Development of the ability to make 
^ declslodis basisd, on the r^ults of 
using the tecnhlliueff 


Yea 


Yes 


7. Ote at Ion of a more positive attitude 
toward operation^ research In 
educational administration 

& ■ . ■ ■ 


Yes 


No 



thig should not pont^dLct the conclusion' Stated above. Thex'e are a number 
of small differences in the instructional goals of the two sets of materials. 
For example, in the linear programming competitor, an attempt is made. / 
to impart a simple pictorial understanding. of i^n optimvim solution while this 
Ls not done in *^Linear Progis^mming J' In no instance' are these^ffere-nces 
so major, however, as to sidbstantliily'alter the list of goals as given in > 
.Table 15 and in no case dp- they change th^ attribution of goals. 



\ 



4 



Conclusion 



> ^ Thls cost ^nd benefits analysis of the , DM/DM materials 



competitors has revealed two ^Cmpoiiant results, flv 



no 



difference In c^st of using the Idm/DM materials lor. their competitors. 




is essentially 



Second, 'using the-DM/DM materials results^ in; two :nore benefits than using. 



the coxftgetltors. The conclusion of this analysis 



ist bd that if -the decision 



maker considers It Lmpp^tant to learn about usipg \^ computer as a problem 

solving tool in. educatiffoial administration and to identify types of educational 

. ■■ ■■ -v ■ 

problems which/may be solved by four ibperatlons^esearch techniques, as ^ell 

' *' • ▼ ■ * . ..." 

as to create an awareness 6f operations research techniques In educational 

admrni3trators, then he. will gain more benefit by using the Data. Management 

& Decision Making materials. ^ ^ - 



'CONCLUSIONS AND RECOMMENDATIONS ' 
Th/ summa ;vo c nclusion of'-this Technical Report Is that Data 
Management & Decision- Making Is a ^validated ^Stodilct wlth^ respect to ItS^ \ 
use as instructional materials In college courses^— This has , been Concluded 

# 

for. the following' reasons. In the needs assessment, it was demonstrated 
• ■ A . • • ' 4* . - « • 

that \^among^ajk least two of the . three target groups for these materials; 
students of ef^ucat'onal administration, administrators, and professors^ of 

r • - ' • :•. 

educational administration, "there is a need for training maferialfe Ln tKe 

■ ■• : - - - ... ■ ■ ' 

four operations research techniques of concern In the ^ipiaterlals*. * In the 
pilot test, it was demonstrated that the DM^JJM materialb^can. cause learning 
abop*- operations research techniques in that students evidencet^ increased 

' attainment of the Instl^ctLonal objectives a|ter Ayorkin^^ through the materials. 

'-■ . . • ^ --■ , *^ - ' ' • ,■ ' • 

- ' *■ * - ' . . - '7-- " • ' • ' 

This pilot t^st also shmyed that using the' DM/DK materials :could changOi 

somef attitiides tttw£(3*ds operations research In education in a positive. 

direction.. In the.f-ield tjsst. It was again demonstrated that the DM/DM 

■ / \ ; ? - ■ ' ■ • < « 

.■».'■' ,r.'.'' . ■ 

materials cause. "learning* Moreover, 'It was demonstrated that in some but 

. ■• ;■■ . ■■■■ V 

not all cases It causes significantly j more learning than its most* likely 



{ 



competitors, and In all cases >4t does no worse .*-han the competitors. It 
also, demonstrated that apparently no changes were evidenced in an overali 
measure of attitude towards pperatLonsj^research In ^education no matter , 
whether the materials-were DM/DM- or their competitors. ^ This, Is not a* . ^ 

. * . ■ ■ ■ ■ 4 -. . 

negative conclusion, since this attitude was generally quite positive when. the 
.students entered the course. As a result of the field test, it was'also 
demons ti'ated^ that the DM/DM materials applarently had several positive side 



effects havli^g to do -with using the computer arid Increased njotlvatlon 'to • 

learn about operatiops^ research techaiques. Wheii these were conxpared witEi 

the comiJetltors, it was evident that the competitors had. fewer positive side" 

effects and did not have any of the minor negative ^Ide effects of the DM/DM 
* • ■ • 

• • * 
materials. Finally In the cos^s and benefits analysis. It was revealed that 

for a cost approximately eqi^l to that of its competitors, the DM/DM 

materials could' del Ivey a, greater number of' benefits to the user. If the. ^ V 

decision maker considers favorable experiences with computers ^airf ^eat^r - 

motivation toward learning about operations research to-be valuable benefits, 

then Data Mana.^ement &'Declslon Making Is more cost-effective tban Its 

competitors..' * " ^ ' ■ . " 

• For 'tKe r^sonsVstated above. Data Manageme nt" & Decision Making is 

' . - ^ ■ ■ - ■-'■"^^ ■ , ■* . ■ 'L 

a vdlldated product with respect to learning,, both cogAltlve "and affective, , ; 
cost and' bi&nef Its, *ai^d side- effects.*^ 'I^lnce It meets a need and. Is a validated • 
prodtxct that me^ts an empirically established need. It Is a worthwhile, product. ; 
Finally^ because It compares -f^-vorably with Its likely^ competitors, It has \ •* • 
relatively more, worth in the educational marketplace, * -. , ' ' r 

Based on these conclusions, • It Is recommended that dissemination of 
this prpduct be initiated and that a publisher be sought for this product. 
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OBJECTIVES OF THE DATA MANAjGEMENT & DECISION MAKING UNITS _ | 
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OBCtECTIVES for introduction to. "OPERATIONS RESEARCH' 

1. General OblectLver v^The student, will know and comprehend the' 
corvcept of .'Dec ision ppti'text. ' * . . 



a. Behavioral .Objectlye: The student^. will .$e able --to . define tiie 
terai decUlpn context, (p.. 4)r ^ 

b. ^ Behavioral Objective; The student will list and >ieflne the • 

three coinponenti^ of a decision context, (pp. 4«-5) . 

c. Behavioral Objective: -'"The student will be able to identify/ 
the three components of a decision context'^lven a spelclflc 
problem In educational administration, (pp. 5-6) . . 

General Object Ive ; The student will know and comprehend the concept' 
of decision strategy. ^ ^ • r • ' 

a. Behavioral Objective; The stodent will be able to define the ' 

. ■ ~T ' ' ' , 

term decision strategy, (p^.'S) ' -rj^j^ * ' . ' , 

' i- ■ • / • . ' ■ ■ ■ • ' ' 

b. Behavioral <Dbjecttve; The student will be able'to list and describe 

■■ r ■ - ■ . .. i ' ■ . . 



2. 



thfe four characteristic components of a decision strategy, (pp. 8-10)^ 



General ObjecL Ive ; The student will know -'and comprehend the concept 



■ of payoff, , r ' ' I* 

' ^ a. Behavioral Objective; The student wlir be ablp 'to define the - 
concept of payoff, (p. 10) ^ * ' ' , . * / 
b. Behavioral Objective; The student wlU be able to identify possible' ^ 
payoffs in an educational administration problem sltuatlbn. ' (pp, lO-'ll) 



.. 1 Page numbers ia parentheses refer to pages In' the text where the object Ive;, 
;ls addressed. The text are the units :a'ccompanylng this^ report. \ 



• 4, General Objeotlve:' Th^ subject will know the tneanlng of the term 

;l- oper^U^is research and will be' fatriillar with four techiilques' of 

^ " " ' ' , . . • ' ' ■' 

^';ppe rat Ions research. 



.J^ AC '> 



a, ' ^Behavioral Obiectlve; The studehf^\^4^^e able -to define the 
i ^ terfn operatic research^ (p'r^' 12) . ' .v, , . r- 



b. Behavioral (objective; The Stuclenit^Vlii^^^^^^^^^^ to list four 
Av Operations esearch technique^'^and brlefly'^d^ ^hat .^e?^ 

of ediiQ^tlon/ l -admlnis eac^j technique Is tnostr 

' * appUcable. 1.PP. I^^^^ ^ iV ■; #'f'"^' 
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OB'JECTIVES FOR "PERT/CPM" 

General Objective; The student will know, comprehend, and apply 
the concept of PERT/CPM as a problem-solving tool in educational 
administration, 

a. Behavioral Objective; The student will- be able to derme the 
PERT/CPM terms prpject (p. 5), activity (pp. 5-6), event (p. 8) 
and network (p. ?)• 

b. Behavioral Objective: -The student wilx be able to describe the 
three uses of dummy activities in PERT/CPM networks, (pp. 12-15) 

c- Behavioral Objective: The student will be able to define the 
terms: Earliest Start, Latest Start, Earliest Finish, Latest 
Finish, and. Slack Time. (pp. 17-23) 

d. Behavioral Objective: " The student will be able to cons,truct a 
BERT/CPM netwprk, given a list of activities .for a project and 
each activity's, immediate predecessors, (pp. 7-15) 

e; Behavioral Objective: The student will be able to define the concept, 
of crltlcalpath in a PERT/CPM' network, (pp. 23-25) 

f. Behavioral Objective: The student will be able to translate the 

\ ■ ■ # 

times given|)in a complete PERT/CPM chart Into calendar dates 
' specifying the earliest start date and latest completion date for 
' . the activities in a project", (pp. 33-38) 
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General Objective; The student will be able to use the computer 
program GCPATH. ^ . . 

a. Behavioral Objective: The student will he able to cause the proper 
execution of the computer program GCPATH by" entering the 
appropriate response to the interact iye- questions asked by the' 
. program, (p. 30) • ' ^ 

c* Behavioral Objective: The student will be able to find the critical 
path ii^ a PERT/CPM network using the computer program 
GCPATH. (P- 31) . . . 

d. Behavioral Objective: The student will be able to correctly interpret^ 
each item of Wormation given in the output from GCPATH. (p. 31) 

General Objective: The student will be able to use PERT/CPM as a 

i 

decision-making tool With reference to specific problems in educational 

•t 

administration. , ' ' 

a. Behavioral Objective: The student will be able to identify at least 
five educational administration projects for which PERT/CPM is 
applicable.- (p- 4) 

« 

b. Behavioral Objective: The studeiit will b^able to describe the use 
of'^PlERT/CPM as a communications tcoL (pp. 33^-38) 

c. Behavioral Objective: The student^will J^e able to choose between' 

^ two or inc>;;e decision alternatives and justify his choice by referring. 

t 

to the principles of PERT/CPM, given a specific project planning 
problem In educational administration. (Not directly approached but 
dealt with by exercises on pp. 27 and 38.) ...» - 
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OBJECTIVES FOR "LINEAR ' PROGItKvDVIING" 

General Objective; The student -will know, comprehend, anS^apply the 
concept oi linear programming as a problem-solving tool in educational • 
administration. • . ' ' . * 

a. Behavioral Oblective; The student -will be able to define the terms 

constraint <pp. 5-6), controllable variable (p. \5)y object function (p. 5),^ 



and measure of effectiveness (p. 5). 



b. Behavioral Objective: The student will b6 able to contruct a * 
m^athematical model (constraints, controllable variablek\and object 
functiony: for a simple problem in linear programming (pp.v4-8). 
>c. Behavioral Objective:' The student will be able to distinguish between. 



possible andMDptimal solutions to a linear programming probk ji. 

^ ' "■ • 

' (pp. - 12-13)- ^ . / . \ 

d. Behavioral. Objective: The student will be able to outline the general 
Steps necessaiy in. solving a linear programming problem, l (pp. '30-36)^ 

'{ ' • - ' I> ' 

General Oblective : The student will be able to use the computer program 

V ■ - ■ -.i- ^- ■ , ... i . 

LINPRCt. ' ' ' i * 

r . ■ .. 

a. Behavioral Ob iecujvej; The student will be able to constru^t^and 
enter ihe proper. DATA statements, given a specific mathematical' "1 
model of a linear programming problem, (pp. 17-20) | . 

. . ^ ^ . . " ■ r . '■ [ . ■. 

b. Behavioral Objective: The student will be^ able tjj^cause a. proper 

' execution of the computer program LINPRG \)y entering the approprtate^ 
response to the interactive questions asked by the program. (pp.*'<20-24) 



te. Behavioral Objective: The student wlllibg able to 'correctly 
interpret the output of'LINPRG as the solution of the linear 
programming problem, (pp. 24-25) 
General Objective: The student will be able to use linear -prograjmnlng' 
as a decision-making tool with reference t6 specific problems In 
educational administration. * . . * . 

a, ^ Behavioral Objective: Hhe student will be able* to describe th^ 

general type of problem to whl<;h the technique of linear programming 

Is applicable, (p. 3, 31-32) 

^ ^ ■ * . * -> 

i>. Behavioral Objecth'e: The .student will be able to list two reasons 

. • .. . . . ^ - 

why the technique '.of linear programming has only recently; been used 
in educational administration.' (pp. 29-30) ' ~ . 

c. . Behavioral Objecti:ve: ^ The student will be able to list five typical • 

resources to be allocated In educatlonal-probleims and five quantities 

^ o , ' 

which could be used as measures of effectiveness, (pp. 31-32) 

d. Behavioral Objective: '^ The student will be able to list five advantages 

'■ ■ / . ■ " ■ ^ ■ - ■ 

I) and two disadvantages^ of using the technique of linear progr^imming 
in problenls ofc educational administration/ (pp. 86-^7). 

e. Behavioral Obje*ctlye: .The student will be able to choose^etween 
two or more decision alternatives and to justify his choice by ' 
referrftig to the results of a linear programming analysis, given a 
.piwblem situation in educational administration A^iiich requires 
optimlza^tioii. (All of Part IV: ppr 38-85) - ^ , ■ 
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OBJECTIVES^R "QUEUEING THEORY' 



General Objective; The student will know, comprehend, and apply the 

.concept of queue ing theory as a problem-solving tdol. 

• fc 

a. Behavioral Objective; The student wlH be able to outline the basic 
conditions which problems must satisfy b'efo re queueli^ theory can 
give useful resjul'ts/- (pp. 8-12) 

b. Behavioral Oblectlve^; The student will be able to define the queue ing 
terms: source fiejd, customer, service facility, arrival rate, service 
r^, Idle time and waiting time. (pp. 5-6; 16) 

c. Behavioral Objective: The student will be able to list the queue Ing . 
statistics that can be derived from the basic Information about a 

, * waiting line situation, (p. 25) ^ • 

d. Behavioral. Objective: The student vAilj/e able to Identify In a 

' ' * r 

specific queueing problem , which parts of the problem function as 

constraints, controllable variables and payoff, (p. 33; 40) 

e- Behavioral Objective: The student wUl be able to explain the general 

^ effects on length oi waiting line, waiting time, and probability of * * 

service facility idleness as the number of service facilities or the 

arrival rate, or the service rate varies, (pp. ,37-38; 43; 47-48; 54) - 

f- Behavtbral Objective: . The student wUl be able to Identify the source 

* ■ ■ ' • . 

field, customers, service facilities-, arrival rate alrid service rate 

■ ' ' • • • ' - - 

for a specific queueing problem, (pp. 6-7 and numerous examples . 

in entire booklet) - . , • 



2. General Objective; The studeht will bSe able to use the computer program 
QUEUE. • . • * 

a. Behavioral Objective: The student wQl cause propef^^execution of 
the comfuiter program QUEyE by entering the appropriate problem 
parameters in response to ^he interactive questiftns asked by QUEUE. 
(First example: pp. 24-28). ^ 

b. Behavioral Objective: The student will be able to correctly interpret 
the output of QUEU"E with respect to the queue tng statistics £hat it 

/yields, (p. 27 and other numerous- examples throughoul the text) 

3. ^ General Objective: The student will be able to use queue inf; theory as a 

decisionr-making tool with reference to specific problems in educational • 
dministration. , - ^ • 

Behavioral Objective: The student will be able to choose between two 
or more decisiofa alternatives and justify his choice by referring tt> . 
the results of a Queueing Theory analysis, given a problem^ situation 
in educational administration to '^bich Queueing Theoiy is applicable. 
(Present in all examples of booklet, beginning with first example 
on p. 21). ' 
^ h. , Behavioral Objective: The student will be able to list four advantages 
and four'^'dlsadvantages In using queueing theory for problems in 
educational adinlnisfcration. (p. 55) * 
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OBJECTIVES FOR '"COMPUTEJR SIMULATION" 

■s 

'■^ ' • 

- • .. - ^ ■'■ • 

General Objective; The student will know, comprehend, and iapply tKe 
concept of simulation as a problem-solving tool. 

a. Behavioral Objective: The student wUl be able to define simulation. 
' (p. 3) . ' 

b. Behavioraf Objective; TJi6 student wUl be able -to list the four 
components of a simulation, (pp. 6-7) - _ 

c. Behavioral Objective; The student 'will be able to naUie at least . 
two uses of simulation in an educational settmg^ ^ (Nimierous ^examples 
throughout booklet) - . 

d. Behavioral Objective; The student will be able' to list and describe 
the three classes and two types of simulations. ,(pp. 7-11) 

e. B ehavioral Objective: The student will be able to list and explain 
the four purposes of simulation, (pp. 11-12). . 

General- Objective: The student will *e able to use the computer program 
BUSRUT which simulates bus routing profilems. 

a. Behavioyal Objective; The student will be able to construct" and 
enter the proper DAt A. statements required* for the program. BUSRUT, 
given a map wifh' the pickup locations, /coordinate axes and number 

of children'to be picked up at each stop. (pp. 14-18). 

b. Behavioral Objective; ' The student will be able to cause the proper 
execution o£- .the computer program BUSRUT by entering the required 
Information. In the required sequence, (pp, 18-21) 




a Behavioral Objective: ^The studeat ViU be able to correctly interpret 
the output of the computer program BUSRUT as the solution of the 
bus routing problem, (pp. 21-24) 

d. Behavibrg^ Objective: The student will be able to choose" bet^veeri 
two or mor^' decision alternatives, and justify his choice by r^feirring 
to the output of the BUSRUT program, given a problem situation 
mvolvlng the routing of buses. (First ajtample, p/ 25; others: 
pp. ^-30). . ^ ^ . H 

6ener aLF^i ec t i ve ; The studnnt^wlU be able to use the computer 'simulation 

ENRPEfO', which stpaulates school , enrollment and provides projections. 

a. Behavioral Oj^jectlve: The student will be able to construct and 

' .enter the proper DATA statements required for the progra^ ENRPRO, 
given a table of enrollment data over, at least, a uve year period. . 
(pp. 38-39) . ' . ' 

b. Behavioral Objective; The stude'ht wQl be able to cause the proper 
execution of the program ENRPRO by entering the required 
Information in the required sequence, (pp. 40-44) - 

c. Behavioral Objective: The student will -be able to correctly 
interpret the output of the program ENRPRO with respect to 
projected ^rollments, year-to-year comparisons^ and projected 
versus actual -enrollment, (pp. 44-52) . ^ 

d. Behavioral Objective; . The^^student will be abie.^to choose between' 
two or moi^e decision alternatives and justify his choice ^by referring 

^ )^ ■■ :•■ .. ■ " ■. ■ - ' 

to an euTollment projection produced by the program ENRPRO, : 



given a problem situation in educational administration inv^olvii^ 
enrollment projections, (pp. 60-67) . 
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APPENDIX B 



NEEDS ASSESSMENT INSTRUMENT 
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Northwest 
Regional 
Educational 
Laboratory 




Lindsay Building • 710 S.W. Second Aveniie 
Poaland. Oregon 97204 • Telephone (503) 224-3650 



May 10, 1974 



Dear 

The Northwest Regional Educational Laboratory Is presently engaged in 
planning. for the development of instructional materials which are Intended 
to focus on some of the techniqufes of modem management and which are 
targeted for educational administrators, hi preparation for tUls work, 
practitioners, professors and students of educational administration are 
being surveyed. " The purpose of this sur^vey is to determine If the topics 
that'' are being considered for inclusion in the materials are, in fact, , 
- considered important by persons involved in educational administration.- 

The short questionnaire that you will find .included with this letter consists 
of a listing, of possible admlnisttative problems which are solvable by the 
techniques xmder consideration for Inclusion in the materials. We would 
greatly appreciate it, if you would respond to* this questionnaire from two 
points .0^ view — how often the problems occur and^ how important they are/ 
Responses in the lefthand column should'jeflect the frequency with which 
you encountered the listed problems. Please use the rl^thand column 
to indicate: the unportance of training to help administrators deal with each 
of the listed probleftis, * - " ; , * 

• Enclosed you will also find a self-addressed, stepped envelope. After 
filling out the questionnaire, plea'se put It in the envelope and dit)p It In 
the mail. It would be helpful if you could fillj out this questionnaire and 
return It within 10 days; We realize that your time is strictly budgeted 
but the few mdments necessaiy to complete this form ^wjould be greatly. 

. appreciated. Thank youWery much for your time and effort. 

Sincerely, * * 

Stuart M. Speedie 

Computer Technology Program ' • 

SMS/n . . 
Enclosures 134 



PROBLEMS . - . * 

' E>-COtNTEilED MANAGEULVL ,Fl XCTIOX . ' TRAINING MATERIALS 



Please check only one box. • . Please jcheck only one box. 

NeedecL 





Some 


Hardty 






Needed 


But Not 




Often 


ti;ne' 


Ever 




Vew Much 


.Essential 


Not Xedded 


n 


n 




1 . 


Understanding the decision^ihaklng process 


n 


n 


n 

1 1 


□ 


□ 


□ 


o 


Planning projects 


■ □ 


- '□■ 




□ 


□ 




' 3. 


Analyzing ongoing procedure^ for efficiency 


□ • 


□ 


□ 


n 


n 


n ' 


4. 


Minimizing costs 




LJ 


n 


□ 

- 1 — J 


n 


n 


5. 


r 

Analyzing the efficiency of school district * 


n 


• n 


i_j 




□ 


y □ 




services 

■ y ' 

- .Allocating time for the accomplishment of tasks 


, □■ 


■, □ 


■ □ 


n 


n 

1 1 


□ 


< . 


Minimizing the^ waiting time for a particular 
service 


; □ 


Fl ' '■ 

1 1 


■ □ ■ 


n 

I I 


n 


□' 

1 1 




' V 

. L nderstdndmg the mteraction of school 
district systems 


' □ . 


□ 

Li— 1 




□ 


□ 




9. 


Roiitias: school buses . * " ^ 


□ 




□ • 


□ 




- □ 


10. 


Scheduling activities so as to meet a deadline 


■ Q 


a. 


■ □ . 




. 'u 




11. 


Sijnultaneously minimizing costs while 
maintaining qualitj*^ of an activity 


■ □ 




□ 




□ 


. □" 


12. 


, Maximizing fhe utilization of service 


,□ 


. □ 


■ 1-1 ."^ 




\ 






facilities ^ 






r » 




□ 


□ 


13. 


Predicting changes in school enrollment 


U- 

> 




■• □ ■ 








14. 


. ■ .* 

Identifying options- in decision making - 


□ 






□ 


a 


n 


15. 


AUoL-atiag budg^tarj' resources efficiently 




□ 








■ □ 


16. 


SiniuUancously satisfying a num^'fer of 
. different goals* j . * 


u 


. □ 








□ 


17. 


■Determining the-probable outcome of a 


□ 


□ 


• ; u ■ 



• particular decision without actually *' ' 
implementing the decision i ' ' 



ID; 

(last 4 digits of your SS no. ) 



Date:- 



For each applicable item circle the letter of the 
best answer. 



Form: i p 



ERIC 



136 



A decision don'text is: 



a. a choice between two different options 

• b. the administrator's environment 

c. a problem for which a decision is needed 

d. the school district of the administrator 



List and, briefly define the three components of the decision context- 
Cojmponent ^ 
1 1 ■ ' ■ Dfn; , ■ r- 



' 2 ' Dfn: , ■ 

- - - / 

7 

/ 

3 Ofh: / 



.1 ^ superintendent. Your school board has just ^ 

^u^Im aU.chUdren should have.at least 18 weeks of career 

education by the time they reach the 'seventh grade. Only grades 4.5,6,are 
■ to /be involved and the sum of SSO.OOO has bpen allocated. - You have the 

^C°nv irt^. ^""^ °^ °f and to Hire 

as^many consultants as necessary provided you do not exceed the authorized " 



The sum of $50, 000 is: 




_a«v-arpefceived need 

b. ^ a constraint 

c. none of these 

d. V controllable, variable 

n. The E^umber of teachers assigned is; 

a. a isontrollable variable 

b. a perceived need 

c. a constraint 

. d."" none\of these 



\ 

\ 
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III. To develop a plan for career education in tine upper elementary grades is: 

a. none of Wiese 

b. a controllable variable ^ 

c. constraint 

' d. a perceived need 

A decision strategy is: 

a. the process by which a decision is made 

b. a iJroblem for which a decision is needed 

c. the choice , between a number of options 

d. the process of implementing a decisioai 

. /. ■ .\ - ■ • 1 

The. four components of a decision strategy are:^ 

a, perceived need, copsttaints, controllable variables, generation of 
possible solutions 

b, analysis 'of the decision context, decision on criteria for the best 
.solution, perceiving the appropriate need, testing possible solutions 
against criteria for best solution 

c. jajialysis of the decision context, decision on criteria for the best 

solution, generation of possible solutions, testing possible soluUons 
against criteria for best solution 

d. finding controllable variables, decision on critferia for the best' ^ 
V. solution, generation of possible solutions, testing possible solutions 

against criteria for best solution 1 . 

. . - \ 

A payoff is : V 

a. the situation which requires a decision . 
^b, the process of making a decision 

a decision with respect to a specific context 
d. the result of a specific decision ' . , 



Suppose that you have the responsibility for constructing^ the school district's 
budget for the next fiscal'year. You have available to you a full-^time secretary, 
all previous years' budgets and budget estimates from each of your district's 
schools. . The most important paj'off of decision making^in this case is: . 

• 

a. budget length ^ ^ < 

b. ^ time 

c. money r ^ 

d. line item costs 13 8. " v 
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-complex administrative problems 



is a set of powerful' decision strategies foY large "ami 



a. operations research 

b. linear^programming' 

c. mathematical niodeling 
qu6ueing theory- 



List four .important- operations research techniques and match th^m with 
administrative applications for which they are most useful (Any operations 
research technique may be applicable to more than one w-6brem) 



a. 

h.[ 

c. 

d/ 



V 



S 



jplanning and analyzing project stages . • 

^analyzing waiting line problems 
^analyzing .a working model of the decision context 
jproblems in which the constraints and payoff can. 
*be stated mathematically ' ,^fi/ . 

^problems involving service facilities . 
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10. A project Is: 



an organizational unit with fyilte/beginnings and endings 
a set ot interrelated act|vitles^each with a beginning and ending 
_ a set of activities which reqi^ire a mix of human and material resourcesj 
^ ' d. a finite^ complex organizatid^nal unit dedicated to the attainment of a goal 



a. 
b. 

c. 



!!• An' action or/set of actions designed to attain a specific! goal is 



• a. an/activity 

b. an event * 

c, a project 
d^ /a network 



iesi 



•12. An event 



a; is a set of large and complex activities 

b. marks only the beginning of an activity* - 

c. has a d;efinUe duration of time 

d. marks the beginning or ending of an activity 



13/. A diagram which depicts a project as a set of relatio 
by arrows and circles is: 



a. a tree diagram 

b. a network 

c. a project layout 

d. ,,a project picture 




i 



mong activities J* 



14. Which of the four listed bel6w is not a use of dummy activities: 



I. Indicating activity precedence without intervening activities. 

II. ^ "indicating the precedence of activities when two aotiyities begin with the ;< 

,same event. ' s * . o "* -] 

III. Providing single starting and termination ev^^nts for projects with multiple' 

J starts or finishes. • \ 

IV. Eliminating the possibility that two activities will start and end' with the 

I same events. ^ . ' • ' . v 



a. ^ IV 

b. ' Ill 

c. II 

d. I 



140 



131 



Match the foUowing words with "their definitions; 



^Earliest start 
__Latest start 
_Earli1est finish 

Latest finish 

Slack time 



a* earliest; latest start of all immediate successors 

b. ^ earlies'tjfinish of all immediate predecessqrs 

c. latest finish - slack time 

d. earliest 'start time : f duration of .activity • 

e. latest finish - duration of activity 

f. latest start time -^earliest i^tart time ^ 



Construct a TPERT/CP^M network frdm the. information given below. Identify 
each activity arrow by its^' number. 



Activity 

1 ^ 
' 2 ' ' 

3 

4 

5 

6 

7 



Predecessor(s) 



1,2,3 
! 1.2,3 

I 4^6 ^ 



1}, 



/ 



The Critical Path in a PERT/CPM network is the path which 

a, has the least amount of slack 

b, has the gi;gatest amount of slac^k 

c, is the" shortest path through the; network 

d, contains tti'e most activities ^ / 



Below is a PERT/CPM Network 




7^5 13.0;6.O| 

j.OI3.n;(i.o| NC/ \ 



7N6 I2.0,S.2] A-^' 
^ 3.2I2.8;ti.O) Viz 



I. Which of the paths below is the Critical. Path? 



a. 1,3,5 

b. 1.4,6 

c. .2,4,6 

d; '2,3, 5 



n. Below 13 a. calendar for the ^nonth of Mav' 



5 . M . T W T F S . " 

1 2 3 4 5 , 

6 7 8 9 10 11-12 - 
13 14 15 16 17 18 19 

20 21 22 23 24 25 26 -y 
- - 27 28 29 30 31 

/ . . 

Which dates are the Earliest Start and Latest Finish dates for the 
.above project* if the project may not begin before May 7 and must be 
finished by May 18. ..(Assume a" five day uonk vyeek) 

a. May 7,14 ~ ^ j - 

b. May 11,18 

c. May 7,18 f 

d. May^9,.16 ' - , . " 



• . - 

If activity 7 took 2 5veeks .and was preceded by activities 5 and 2, the 
cbrredt DATA statement for^ program GCPATH would be: 

a. 2000. DATA. 7,14,^5,2 ' 

b. 2000. DATA 7,2,-1 

c. 200olnATA 7,5,2,-1 ' ' ' , . 

d. 2000 mTA 7,2,5,2,-1 • . 
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B^low Is a sample output, from program GCPATH 



EARLIEST C0MPLETI0M Tl«E FflR THE EMTIRE PR0JECT m 15-5 



_ EARLIEST ' ' LATEST 



J0B 


START 


FINI H 


START 


FINISH 


sl'acx 




1 


0 


5 ' . 


0 


5 


0 




2 « ; 


S 


8 


5.5 


6.5 


.5 




3-..- 


8- 


10 


^.5 


10.5 


.5 




4 


10 


11 


10.5 


11.5 


• 5 




S 


5 


n , 


5 


,11 


0 


♦CP* 


6 


Ti 


11.5 


11 


11.5 


0 


«CP« 


7 


lUS 


12.5 


12.5 


13. S 


' 1 




8 


12.S 


14*5 


13.5 


15.5 


1 




9 


lUS 


IS. 5 


11.5 


15.5 


0 


*CP« 



D0Ne 



I. Which path Is the Critical Path? ' 

a. 1,'5,6,9 

b. ' 1,2,3,4,7,8 
C. 1,2, '3, 4, 9 
d. 1,5,6,7,8 

II. What is the Earliest Start, Latest Finish and Slack Time for 
Activity 4? . / • ' 

. a. 10, 11. 5,. 5 
- . b. 10, 15. 5,. 5 

^ c. 10, 11, .5 - 

d. "1*0.5, 11. 5,,. 5 - 

List 5- educational applications of PERT/CPM 



PERT/CPM. Is a useful communications tool hocuuse: \ . '' 

• , a. it tells thfe activity supervisor exactly whnt he must do. ' 

b. it displays a project with complex relationships of activities in a 

simple and direct manner.- o^ " .../ 

c; it informs the manager of his management responsibilities. • 
d, it provides a picture of the project" as a set of decision events in 

a simple and direct manner. . * ^ > 



Suppose that you are a school district .^superintendent. You are plahning 
school census^. You have analyzed this project using PERT/CPM. Ybur 
analysis tells you that the. Critical Path is '7 months _long. " 't. is now \ 
April 1, 1973. Your kurvey must be finibhed by August 1, 1974. Which 
is the latest period in which you can initiate ITil i>roject? " 

^. April 1, 1973 tp April '30, 1973 ■ . . ' 

b. October 1, 1973 to July 31, 1974 

c. September 1, 1973 to September ir,, i;)7;; ^ 

d. April 1, .1973 to September. 30, 1973 

Give a reason based .on PERT /CPM for your answer: '1/ 



Give one advantage and one disadvantage of PEJrr CPM: 
Advantage: 



Disadvantage: . -• -. 
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ID: 



(last 4 digitg^f your SS no.) 



Date: 



4^ 



For each applicable item circle the letter of the 
best answer. 



F.orms: -li.E 



\ 



/■.. 
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1. The situation whi6|i|creates the need^for a decision Is the: 



a. decision conte^xt 

b, perceived n 

c, decision str 

d. constraints 



2. List and briefly define the three components of • the decisiqn context, 
Comi^onent 



2: Dfh. 



4' 



3 Dfh. 



3; Suppose that you are an assistant superintendent. You have been assigned, 
the task of establishing a busing program wliich will result in rkcial baiadce 
within your school system* Your district has allocated $100,000 for- btisHig 
using, its fleet of 75 buses. You may adjust the nuniber 'of "students pn^aqgr 
bus, the route any bus will follow and the school or schools to which it : . 
d.elivers. The plan is. to be ready to use at the beginning of school ''this fall. 

I, The school or schools to which a bus delivers ig: 

a. ' none of these , . ^ * 

^ p. a constraint / 7^ m . ' 

c, a perceived need 

d. a controllable varialDle • 



ir. To establish a busing program is • . 

a. a controllable' variable . . 

b. ' perceived need i r I 

c. none of these* ^ 

d. a constraint. . * 

' ' 146 • 
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in* The 75 buses in the school diistrict fleet represent: 



a. a perceived need ^ 

a contrpllable variable/ *.^ ^| 

c, a constraint \ - * ' t , 

d. none of these ^ ' •% 

■ ■ - 'it 

■•■ r . ■ ■ ■ • ■•■I 

The process by which the administrator makes a decision with respect to 'J4 

the decision context' is the: • ; - I 

a. perceived need « ^ /\ 

b. decision context ^ - / 

c. analysis of the decision context ; 

d. decision strategy ^ 



The following four activities 

analysis of the decision context ^ 

• decision on criteria for/best solution » 

• generation of possible solutions 

• testing of possible solutiong against criteria for best solution 

are comppnents of the f 

. . .■ ^ . * . 

a. decision' strategy ^ ^ ^ " ^ 

-b. controllable variables .. . ./ , ' "'\ 

Cir decision; context » 

d. decision variables^ ' ; 

The result or outcome of a specific decision is j ' 

/ : J • 

a. a decision context • 

b. a payoff . . ^ - ^ 

c. . what happens 

d. a decision strategy ^ 7^^^' 



'"1 



It you are responsible ior choosing a new reading series [for the' , p 
sthoolS in your district. The decision- must be made bjj; the sprinf] 
of,, this year and fb\i have been allocated. $25, Ol)0.' What is the moslt important^; 
payoff , for this decision? . j 

• • j 

a. readitig^chievemerit ^ v - ; 

" b. • total "time to prepare ' ^ . " . • :[ 

c. -number pf^xts * 

■d. manhours used . » - . S 
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8. Operations Research Is j 

a* a metbod for the scii^tific study of managemfent or administrative 
, functions . ^ • , r > ^ 

b, ' a method of research desic^ne^l to study business operations V 

c. a^set of powerful decision contexts for large and complex 
adriiinistrative problems^ ^'^^ , - " * i 

. d. a set of powerful decisijon -strategies for l^rge and complex 

/administrative 'problems ■ . ^ ! . , .; 

9. List fguf important operations- I'esearch techniques and match them with 
— administrative^ applications 'fon which they are most useful (any operatiofis 

research technique may be applicable to'more thau one problem). 

a. ^ _j ^planning and analyzing projsgct stages* 

b. > a nalyzing waiting line problems 

c. ■ analyzing a v?orking m6de)rof the decision context 

^d, . : p roblems in which the cotlstraints and payoff can 

can be statecJ* mathematically 
, ' problems involving service facilities » 



• V, 
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10. A complex organizational unit which involves a set of finite related actions/ 
and re^iuires a .mix of huAuan and material resourpes is: / 

a. an activity ' ' ' ' ^ 

b. a project . - 

c. a set of events : ' - ^ , . 

. d. an event \ n ' 



11. An activity is: 



a*, an action or set of actions designed to» attain a goal 

b. a set of complex and Interrelated actions * 

c. a complex organizational unit whic^ requires a mix of human. aiic 
material resources^ , 

d. the beginning or etiding of a set of actions 

12. That which rnarks the beginning or ending of an activity is: 

a. a time ' ^ 

b. a project ' * • ..^ 
\ c. "^an event ' ^ . ■ ' . 

di a network 



13^ .A network ^ a diagram which depicts: , 

a. a prjjject as a set of interrelated events' by means of arrows . 

b. an activity as a set of interrelated events by means pf arrows 

c. an ei^nt^as a set of interrelated acti^tieK^ means of circles and 
arrows 

d. a project as a set of , interrelated activities by means of circles arid 
arrows \, * . . 

^ A . - ^ ' • ' ■ . ■ 
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14. Which three of these listed^BS^ are the uses ol a, dummyv activity r ^^^^^^^ 

I. Indicating the {precedence of activities when two activities e| 

with the same event, i 
II. Eliminating the possibility that two activities will start arid end^^ilp 
' AKith the same events, ' | ^^-^^^^^^^^^ 
llL **Itdicating activity /precedence without intervening activities . 
VI : Providing single starting and termination events, for projects 

witti multiple stapts^ ' " ■^y:,^-^'-^;^^ 



m 



a. I, II, III 

b. 1, 11, IV 

c. .1,111,1V 
'd. II, In, IV 



15. in each of the following items choose the term which matches the dei^initiOtl 



I. " Earliest start time and duration of- the activity 

a. earliest start . , , 

b. earliest finish 

c. slack time 

d. latest start 



II. 



HI. 



r ■ 



Earliest latest starf of all immediate predecessors 

a. slack time , . 

b. earliest finish 

c. latest, start 

d. , latest finish 



I' 



Earliest finish of all Immediate predecessdrs 

a. ' earliest start 

b. earliest finish . 

c. latest start ' > 

d. latest finish 



IV. Latest start time - earliest start time 
. ;a;^:-. . slack time " — 

• b. earliest start 
c^ . latest start ' 

d; latest finish ^ 

V. Latest finish - duration 'of the activity 

a. earliest start 

b. earliest flnjish 

c. late^start ^ , ; - 
^ d. slack time 
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16. Construct a PERT/CPM network from the information given below. Identify 

each activity arrow by its number. 

Activity Predecessors 
1 

2 1 

3 1 

4 3 

5 4 

6 2 

7 5,6 
J 5.6 



17. The longest path through the network in terms of time is: 

a. the path/With the most activities 

b. the pat^ with the fewest activities 

c. the critical path 

d. the' most slack path ' 

: / . 
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Below is a PERT/CPM network 




I. Which of the paths , below is the Critical Path? 

a. .1,2,5 

b. 1,3 

c. 1,4,6,7 

d. ■'1,3,6,7 

II. Belo,w is a calendar for the month of September 

S M T W T F S 

1 2 

3 4 5 6 7 8 9 

10 11 12 13 14 15 16 

17 18 19 20 21 22 23 

_ 24 25 26 27 28 29 30 

If the above project must start by Sept. 18 and be finished by 
Sept. 29 its Earliest Start and Latest Finish times are:. 

a. Sept. 20,29 

b. Sept. 18,29 

c. Sept. 18,28 ' 

d. Sept. 19,29 . ] 

If activity 14 takes 3 days to complete and is preceded by activities 13 
9, 5, the correct DATA statement for program GCPATH would be: 

/ 

J , ' - . 

a. -2000 DATA 14,3,13,9,5,-1 

b. 2000 DATA 14,3,13,9,5 

c. 2000 DATA 14,13,9,5,3 

d. 2000 DATA 14,13,9,5,3,-1 
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Below is a sample output from program GCPATH 

EARLIEST CanPLETION TIME F3R THE EJJTlRS PROJECT » 25 



V 



EARL I EST 



LATEST 



J0B 


START 




FI;J1SH 




START 


FirJISH 


SLACK 




1 


- 0 






3 




I 


4 '. 


1 




2 


3 










4 


5 


i - 




.3 


0 






3 




0 


3 


0 


♦ CP* 


4 


3 






5 




3 


s 


0 


• CP* 


K 


5 






13 




5 


1 3 


0 


• CP* 


6 


13 






19 




13 


19 


0 


• CP* 


7 


19 






23 




19 


23 


0 


• CP* 


8 


23 






25 






/ 25 - 


0 


• CP* 


9 


19 






22 




22 


2 5 




*• 


to 


19 






J9.3 




24.7 


25 


5.7 






L Which path is 


the 


Critical 


Path? 








a. 


1, 


2, 


5,6,7, 


8 












b. 


1, 


2, 


5,6,9 














c. 


3, 


4, 


5,6,7, 


8 












d. , 


3, 


4, 


5,6,9 













II. What is the Earliest Start, Latest Finish and-Black Time for activity 4. 
a. 3,5,3,5,0 

. b. 5,12,5,13,0 * • - 

c» 2,3,4,5,1 
d. 3,5,3,5,1 



21.- List 5 educational applicatioils. of* PERT/CPM 



a. 



'c. 



e. 
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22. Because PERT?/CPM displays a project- with complex interrelationships of 
activities in a simple and direct manner it is a useful: 

a. communication tool 

b. decision-implementing tool " 

c. project monitoring tool 

d. project evaluation tool 



23. Suppose that you are an assistant superintendent of a large school district, 
you have the responsibility to make enrollment predictions for the next five 
years. Using PERT/CPM you have analyzed this project and found that your 
critical path is 3 mojiths long. It is now July 1, 1973 and the project must, 
be completed by May 1, 1974. How long can you delay the starting of this 
project and still finish safely? 

a. September 1, 1973 

b. March 1,1974 

c. October 1, 1973 . 

d. February 1, 1974 ' 

/ 

24. Give a reason based on PERT/CPM for youx*. answer. 



25. Give one .advantage and one disadvantage of PERT/CPM: 
-Advantage: 



Disadvantage: 
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For each applicable item circle the letter of the 
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1. A dectston context is: 

a. a choice between two different options 

b. the administrator's environment 

c. a problem for which a decision is needed 

d. the school district of the administrator 



2. List and briefly define the three components of the decision context. 

Component - - 

1 Dfn: 



Dfn: 



Dfn: 



3. Suppose that you are a school superintendent. Your school board has just 
adopted the policy that all chUdj^en should have at least 18 weeks of career 
education by the time they reach the seventli grade. Only grades 4, 5, 6 are 
to be Involved and the sum of $50,000 has been allocated! You have the 
freedom to assign any number of teachers for any number of hours and to nire' 
as many consultants as necessary provided you do not exceed the authorized 
amount. ^ 



I. The sum of $50,000 is: ^ 

^ , ' , \ 

a. a perceived need ' 

b. a constraint 

c. none of these . ' 

d. a controllable variable 

< 

II. The. number of teachers assigned is: 

a. a controllable variable 

b. a perceived need 

c. a constraint 

d. none of these 

■ 15G 
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III. To develop a pian for career education in the upper elementary grades is 

a. none of these 

b. a controllable variable 

c. constraint , 

d. a perceived need - 

A decision strategy is: 

a. the process b5' which a decision is made 
' b* a problem for which a decision is needed 

c. * the choice between a number of options 

d. the process of implementing' a decision , 



The four components of a decision strategy are: 

a. perceived need, constraints, controllable variables, generation of 
possible solutions. 

'4). analysis of the decision context, decision on criteria for the best 
solution, perceiving the appropriate need, testing possible solutions 
^ against criteria for best solution - 

c. . analysis of the decision context, decision on criteria for the best 

solution, generation of possible solutions, testing possible solutions 
against criteria for best solution . 

d. finding 'Controllable variables, decision on criteria for the best^ 
solution, generation of possible solutions,^ testing possible solutions 
against criteria for best solution ^ 



A payoff is: . 

a. the situation which requires a deciision s 

b. the process of making a decision 

c. a dej^clsioh with respect to a specific contiext 

d. the result of a specific decision " ^ 

■ ^ 

Suppose that you have the responsibility for constructing the s'chool district's 
budget for the next fiscal year. You have availdtole to you a full-time secretar>s 
all previous years' ^dgets and budgets^estimates from each of your districtfs 
schools. The mogt important payoff of decision making in this case is: | * 

* 

a. budget length 

b. time - 



c. money 

d. ' line item costs 
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Is 



a set of powerful decision strategies forMarge and 



complex administrative problems, 

a, operations research 
linear programming 
mathematical modeling 
quei*eing theory ' - 

List four important operations research techniques and match them with 
administrativ.e applications for which they are most useful (Any operations 
research technique may be applicable to more than one problem) 



a. 



Jplanning and analyzing project stages 



analyzing waiting line problems 

^- — . . — __analyzing a working model of the decision context 

^problems irt which the constraints and payoff can 

be stated, mathematically ' 
^problems involving secvice facilities 
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10. A constraint is: 



a. a quantity that we. wish to either maximize or minimize 

b. the measure of how successful we are at either maximizing or 
minimizing . * . 

c. :a restriction on one or several controllable variables 

d. a direct restriction on the measure of effectiveness 

11. A variable whose value can be manipulated in order to get an optimum " 
result is: " ' - . 

- • * 

a. a controllable variable 

b. ah optimized variable 

c. a measure of effectiveness 
a. a constraint^ 

/ . - • ^ ■ 

12. An object function is; 

, a. a restriction on one or more controllable variables 

-b. a mathematical e:q>ression of the measure of effectiveness 

c. the (Quantity we want to either maximize or minimize 

d. a mathematical expi^esslon of the problem's constraints 

■ ■ ■ ^ ■ ■• "i . ■. 

134 The quantity which we;>wish to either maximize or minimize In a linear 
programming problem Is: * ^ 

a. . an object function 

b. , a controllable variable 

* , c. a constraint • 

d, measure of effectiveness 

14. Suppose that you are responsible, for deciding how many reading books to bujr 
, for the first grades in your district. You have decided on purchasing two 

\ series series A and series B.(tj^ is the total number of series A books, 

tg^ls the total number of series B books) Series A books costs $2.50 each 
. and last for 2 years. Series B books cost $4.95 each and last 4.5 years. 

You have $5^000 to spend and you must purchase at least 100 of each series. 
The goal Is to purchase the books so that they last the maximum amount of time. 
Determine the following for this problem: ' 

^ ♦ I. Controllable variables:^ 

• , — . . . r 

II. Constraints: 



i 



/ 



III, Object Function: 



15. Which of the statenaeats below describes tfie relationship between a feasible 
solution and an optimal solution? 



a* the optimal solution is the best of all feasible solutions 
b* the feasible solution Is the best of all optimal solurlons 

c. a feasible solution satlfies all the constraints while the optimal 
solution does not. 

d. there may be a great many optimal solutions but, only one feasible 
solution* 

i - ■ t . :7 

16'. List the seven steps necessary In solving linear programming problem: 



17. Below la a model for a linear programming problem- Write down the DATA 
statements In the correct order for using the computer program LINPRG. 

Ot)^ect. function: 71^ + 5.3t2 = C i . 

/constraints: ti > 50 • 
y < 30 

3000 t^ + 5000 t„ < 20,000 
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18. Below Is an ouiput listing from the program LINPRG. 



• LINEAR pnOGRAKHING • 
HAVE Y0U EjrrEHED Y0UH DATA STATgMEflTS? 
71 

ir *ffAXIMirifjG THE eSJECT FLfJCTieN* TYPE 
ir MINIMIZING THE SDJjECT m4CTt0|l, TYPE 
>1 



NUMBER 0r C9NSTJIAUJTS? . ^ 

JJUMBEH CF VAniABLES? 

NUMBE?^ or UESS-THAM C0MSTnAIHTS? 

NCMBEH BF EOOAUITY CBMSTRAINTS? ; 
?0 

NUMBER 0F GREAT EH -THAN CeNSTFAINTS? 
•>2 



/^NSVERSi 

THE MAXIMUM VA^UE 0F THE 0BJECT FU>JCTI8N IS 556*4 
THIS 0CCUR5 VHCNj 

VAniABLE I « 13.04 

. VARIABUE Z • A 

ANY VARIABUES NOT LISTED HAVE VALUE 0 

D0NE 



Object function: SSt^ + 25t2 = C 

Constraints; tj^ < 22; t2 > 4; SSOOt^ + S370t2 < $8000 

t^ represents the nxrtnber of Type A science centers ($500@) and 
t2 represents the number of Tj^De B science centers ($370@). The 
object function a;ttempts to maximize the number of cliLldren served 
by science centers. 

L How many Type A centers should be purchased? 

n. How many Type B cpiiters should be purchased? 



r in. How many children will be served by these centers? 



19. Linear programming Is primarily useful in dealing with problems where: 

a. one Is able to quantify the variables Involved in the problem 

b. resources are allocated so as to optimize some result 

c. resources are allocated so as to maximize some quantity 

d. resources arr;? §Ulocated so as to minimize some quantity 

152 
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Which of the following alternatives represent two reasons why the technique 
of linear programming has only recently been used in creation: 

a. Important educational variables are difficult to quantify. 
Linear programming Is applicable to only a small number of 
educational problems « 

b. Linear progr ammin g was developed cfnly recently. There has not 
been much time to develop educational applications. 

c. The necessary mathematicians and computers are^not generally 
avaUable to educators. It Is necessary to have specialized 
training to use linear programming. 

d. ^ toportant educational variables are difficult to quaptlfy. Few 

educators are aw^re -of the existence of linear programming. 

List Ave typical resources to be allocated la educational problems. 

. -\ 

a» ^ 

> 

b.' , - ■ 



,e. : " - ^ ■ - 

Which of the following four is ^not an advantage of using the technique of linear 
programming In solving problems in educational administratis? 

a. provides fast answers at little cost 

b. provides a rational basis for decision making 

c. provides a method for quantifying goals 

d. provides a means for simulating changes and observing the results 

Which of the following is a disadvantage of using the technique of linear 
progi^ammlng ? . 

a. linear programming provides data but does not make decisions 

b. the technique is too sophisticated to use for educational problems 

c. it requires mathematical sophistication to use the technique 

d. linear programming often does not provide a best answer • 

J' " 



162 

153 



ID: 

(last 4 digits of your SS no. ) 



Date: 



For each applicable item circle the letter of the 
best answer. 



Form: n L 



> 

The situation which creates the need for a- decision is' the: 

a. decision context > 

b. perceived need 

c, decision strategy 

d, constraints 



List and briefly define the three components oi the decision context. 
Component 



1 


Dfn. 


















2 


Dfn. 




V. ,^ ■ 








y 






3 


Dfh. 









Suppose that you are an assistant superintendent. You have been assigned 
the task of establishing a busing program which will result in racial jbalance 
within your school system. Your district, has allocated $100,006 for busing 
using its fleet, of 75 buses. Y"ou may adjust the number of studeijts qn ady 
bus» the route any bus. will follow and the school or schools to which it 
delivers.' The plan is to be ready to use at the beginning of school thl^: 

I. The school or schools to' ^hich a bus delivers is: 



a. none of these 

b. a constraint 

.c.t a perceived need 

d. ^ controllable variabiai* 



11. To establish a busing program is 



1 



a. 

b: 

c. 
d. 



a controUal^le variable 

perceived need 

none \of these 

a constraint 1 (5 
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m. ^The 75 buses injjie school district fleet represent: 



a. a perceived need 

b. a controllable variable 

c. a constraint 

d. none of these 



4. The process by ^vhich the administrator makes a deciiion with respect to 
the decision context is the; 

a. perceived need ' ' - \_ 

b, decision context ^ 

c. analysis of the decision context 

d, decision strategy 



5. The following four activities 

• analysis of the decision context 

• decision on criteria for best solution 

• -gsneratioa of possible solutions ^ 

9 tkisting of possible solutions against criteria for best solution 
are components of the 

a. ' decision strategy . . \ 

b. controllable, variables 

c. ^ decision context 

d* decision variables ' ; 



6. ' The result or outconae; of a specific decision- Is 

a. a decision context * l^^! _ ?^ 

b. a payoff " 

c. what happens 

d. a decision strategy 

7. Suppose that you are responsible for choosing a new reading series for the 
elementary schools in your district. The decision\must Jfegljim^ 

/ of this year and you have been allocated S25, 000. What is tire "Wst^i^ 

; payoff for this decision? / ^ | 

a. ^ reading achievement / 

b. total time to prepare 
c* number of texts 

d. manhours used 



II L 




Operations Research ts 

a^gjhethod for the scientific study of management or administrative » 

functions \ 

a method of research designed to study business operations .\ 

c. . a set of powerful decision contexts for large and co«iplex 

administrative problems 

d, a set of powerful decision strategies for large and complex 
administrative problems 

List four important operations research techniques and match them' with 
administrative applications for which they are most useful (any opeVations 
research technique may be applicable to more than one problem). 

a. planning and analyzing project stages 

b. ^ ^analyzing waiting line problems 

c. analyzing a working model of the decision context 

d. ^problems in whicli the constraints and payoff can 

can be stated mathematically 

^ ^problems invoU^ng service facilities 
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10. A restriction on one or more controllable variable? is: 

a. a controllable variable 

b. a measure of effectiveness 

c. an object function 

d. a constraint 

11- A controllable variable is: 



a. a quantity we wish to either maximize or minimize 

b. a variable which can be manijiulated in order to get an optimum • 
result * , 

c. a mathematical expression of the restrictions on certain variables 

d. the mathematical expression for the measure of affectlveness 

12. A mathematical expression of the measure of effectiveness is: 

a. the object function . 

b. , a controllable variable 
, c. a constraint 

d. an optimizer 

13. g The measure of effectiveness Is: 



o 



14. 



a. the quantity we wish to either maximize or minimize. 

b. .a variable which can be 6irectly manipulated. ' 

c. k restrfction on one or more controllable variables- 

d. a mathematical expression for the controllable variables. . 

"Suppose that you are responsible for deciding how many science centers to 
buy for your new school. You. have a choice of two types S, Z . Type S 
costs $750 and serves 20 students. Type Z costs $475 and serves 25 
chUdren. (t^ is the total number of type S centers; tg is the total number " ^ 
of type Z centers) You have $10;000 to spend iind you, wish to maximize 
the number of children served. You must buy at least 3 of each type^ 
Determine the following for this problem: 

I. Controllable variables: 

n. Constraints: 
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m, Object Function : 



15. The solution is of all / - solutions. 

./ 

a. ' feasible, the best, optimal ^7 

b. optimal, one, feasible 

c. optimal, the best, feasible 

d. feasible, one, optimal 

• 16. List the seven steps necessary in solvlhg a linear programming problem. 



17. Below Is a model for a linear progranxmlng problem. Write down the DATA 
statements In the correct order for using the computer progpram LINPRG 

J Object Function: mt^ + 75t^ = c ' 

/ Constramts; 5t + 3t2 = 250 

ti < 30 ^ 
t2 > 50 
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18. Below Is the listing for a linear programming problem solved by the computer 
program LINPRG. 



LINPRQ 

• LINEAR PnaCRAMMING • 

HAVE Y0U EMTERED Y0UR DATA STATEMn»TS7 

<YES*M** N0«'O*> 

71 

iV MAi<IMl2lNG THE 0BJECT FUNCTION/ TYPE 

IF MINIMIZING THE 0BJECT FUNQTI0N/ TYPE '-I 



NUh^CR 0r C3HSTRAI/JTS7. 

NUMBER 0F VARIABLES7 
72 

NUMBER 0F LESS-THAN C0NSTRAINTS? 
71 

NUMBER er H'QTJAHTY C0NSTRAIWTS7 
70 

NUMBER 0F GRilATER-THAfi CflNSTRAINTS? 
72 



ANSV3CRSI * 

THE MAXIMUM VALUE 0F THE 0BJECT FmjCTlBN IS |?A3,a2 
THIS 0CCUBS WHENi 

VARIABLE I -50 

VARIABLE 2 • 584.21 I 

ANY VARIABLES N0T LISTED HAVE VALUE 0 
MNE • 



Object function: 1.5ti -f 2t2 = L ■ ^ 

Constraints: ti > 50, t2 > 75, $4.50 + $4.75 tg < 3000 

, j ti represents the number of textbook S ($4.50 @) and t2 
represents the number of textbook Z ($4.75 @). The 
object function attempts to maximize the cumulative length 
of time that the textbooks will last. 



I. How many S textbooks should be purchased ?_ 
n. How many Z textbooks should be purchased?,^ 



m. What Is the cumulative length of time the textbooks wUl. Iast ? 
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19. Linear proprammlng Is useful for solving problems in which _1_ 
are allocal^d so as to ^ _som'3 result. 1 

a. quantities, maximize 

b. resources, minimize 

c. quantities, maximize 

d. resources, optimize 

20. Which of the following choices give two valid reasons why linear programming 
Is presently used so little in education: 

a. Import^t educational variable are difficult to express numerically. 

It Is necessary to have specialized training to use linear programmlag.l 

b. It Is difficult to' express Important educational variables numerically; ) 
Few educators are aware of the existence of linear programming. 

c. There has not been much time to develop educational" applications. ^ ■ 
It is necessary to have specialized training to use linear programming. 

d. The necessary mathematicians and coicnputer are not generally 
available to educators. Linear programmiag was developed only 
recently. 

21. List five typical resources to be allocated In educational problems. * i 

i 



e. 



22. * List five pleasures of 'effectiveness In education?) proSlerns. 

a. 

J — — ^ — 

b. _ [ . 

c 

c. 



e, 



n L 



T.T-- 




n L 



Which of the following four Is not an advantage of using the technique of linear 
programming in solving proble.tifis In educational adm'lnlstratlon? 

a. provides the criteria for decision making. 

b. encourages identification of goals 

c. provides a format for systematic analysis of a problem, 

d. provides fast answers at little cost ^' « 

Which of the following four is a disadvantage of using the technique of linear 
programming. 

a. the technique is too sophisticated to use for educational problems 

b. the technique is slow and costly W^use 

c. It Is necessary to be sophisticated mathematically to use Linear 
Programming 

d. Many real-world- situations are difficult to formulate mathematically 
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A decision context is: 

a. a choice between tWQ different options 

b. the administrator's environment 

c. a problem for whjch a decision is needed 

d. the„ school district of the administrator 



3t and briefly define the three components of the decision context. 

Component 
1 ' Dfn: 



2 Dfn: 



3 Dfn: 



ouppose that you are a school superintendent.. Your school board has just 
adopted the policy that all children should have at least 18 weeks of career 
education by the time they reach the seventh grade. Only grades 4/5,6 are 
to be involved and the sum of $50^000 has been allocated. You have the 
freedom to a*lgn any number of teachers for any number of hours and to hire 
as many consultants as, necessary provided you do not exceed the authorized 
amount. 

I. The sum of $50,000 fs: , - 

a. a perceived need 

b. a constraint 

c. none .of these 

d. a controllable variable 

II. The number of teachers assigned is : 

• a. a contrpllablc variable 

b. a perceived need 

c. a constraint 

d. 'none of these 



III. To develop a plan for career education in the upper elementary grades is: 



a. none, of these . 

b. a controllable variable . . - 
y c. ^cbnstraint 

d. a perceived need - ^ 

A decision strategy is: o - 

* 

a. the process by which a^decision is made . 
h. a problem for which a decision is heeded ' 

c. the choice between a'number-of options 

d. the process of implementing a 'decision 

The four components of a decision strategy .are: 

a. perceived need, constraints,, controllable variables, generation of 
possible solutions 

D. analysis of the decision context, decision on criteria for the best 
solution, perceiving the appropriate need, testing possible solutions, 
against criteria for best solution • . 

-. c. analysis of the decision context, decision on criteria for the best . * - 
solution, generation of possible solutions, testing possible solutions 
^against criteria' for b-^st solution 
d, landing controllable v£* -iables, decision on criteria for. the best 

solution, generation of pos'^ble solutions, testing possible solutions 
against criteria- for best splution . 



A payoff is: ^ 

a* "the situation which requires a decision ^ 

b. the process of making a decision 

• c, a decision with respect to a specifi^c context 

d. the result of a specific decision 

Suppose that you have the responsibility for constructing the school district's 
budget for the next fiscal year. You have available to you a full-time secretary; 
allpreviousyears' budgets and budget estimates from each of your district's 
schools. The most ^^ortant payoff of decision making in this case is: 

a. budget' length • * 

b. time ^ 

c. money 

d. line item costs * . 
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is 



a set of powerful decision strategies for farge and 



compltix administrative problems. 

a. . operations research 

b. linear programming 

c. mathematical modeling 

d. queueing theory 



List four important operations research techniques and match them with '■ 
administrative applications for which they, are most useful (Any operations 
research technique may be applicable to more than one problem) 



a. 
b. 
c. 
d. 



_planning and analyzing project stages 
_analy zing waiting line , problems ' . 
_analyzing a working model of the decision context 
jproblems in which the constraints and" payoff can 

be stated mathematically 
_problems involving service facilities 
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10. Simulatibn is 

a. making, reality easier to understand 

b. role playing 

c. representing reality by using a computer 

d. giving the effect or appearance of reality 

11- Which of the following is not a component of a simulation? 

a. Object system 
: b. .Controller 

. c. Model 
d. Output 

12. Name two uses of simulation in education, 
a. ^ ^ 



13.. Which of the following is not one of the three classes of simulation? ^ 

i a. computer-computer 

b. man-model 
All -computer 

d. man-computer . 

14* Which of the below is not i type of simulation? ^ 

a. deterministic 
h. stochastic 

c. organic . 

,15. Which of the folHowing is not a ^purpose of simulation? 

a. Copy reality/ exactly. * 

b. Predict future behavior of the system • 

Describe the object system. • 267 

Y^jJ^^ .d. Teach about the object system* . 

fcKJC / 1/6 
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a human being interacts with a computer to provide inputs td the 
model controlled by the computer, It is a/ s imulation. 

a. man-model ! ^ | " ' 

b. all-computer \ 
man-computer 

' d? com'puter--computer 

When a simulatidb has exact rules for relating each possible inputs to a 
specific output, the simulation is ' a s opposed tc r ' ' • . 

a. stochastic,' deterministic • . ^ 

b. deterministic, stochastic • • : 

c. organic, deterministic 
. d. logarithmic, stochast/c - > ^ . • - *^ 

Assume that you are constructing DATA statements for the BUSBUT simulatu^n^; 
program. The stop that you are working on now is number 12. ,It is in the . 'i 
16th row and 2nd colunin and there are 7 children to pick-up. \Vrite \Yie 
proper DAT/ statement on * the dine below. ^ 



Below is the output from the BUSRUT simulatipn. Read through the listing .;, 
and answer the questions below. 



oirtn THE^scHeeL cbbrdinat&s, separated by a csmma. ^ 

THE VERTICAL COORDINATE SHOULD B£ FIRST 
?I5/I7 ' ' 

VANT T0 CHANGE BUS CAPACITIES? YES-l,fN0.O 

71 , . , 



Y0U WILL BE ABLE TO EMTER THE CAPACITY 0r EACH VEHICLz* 
TYPE, WHEJJ EJJTERING, R£«r>,OER rHAT THE CaMPtJTER VILL 
RUN R9UTES IM THE 9RDER £>ifcnED: ENTER 0NE AT A TIMr 
WHEN A buESTl^N MARK \aPPEARS, UP Ta 5 P^-TRIES. ENTE^ 



0 IF Na M0RE ARE DESi\reD 
CAPACITY' I • 
736 \ 

CAPACITY 2 ^ . ■ . 

70 ^ ' 

VANT T0 CHA^JGE NUMBERS' 0F BUSES? YES-l, N0-O 

ENTER THE NUMBER 0F 36 -PASSENGER BUSES 

ENT:.R the average rate BF travel in rtPH 

ENTER THE NUMBER GRID LINES PER MILE, 

712*^^^ ^AMP^E/ IF A aUARTEP-MILE GRID IS USED, E.NTER 0 
E^•TER CaST PER MILE TD 0PERATE BUSES 

R0UTE J * . ; ,. ' y- 

STgp STUDEJnS MINUTES - ' 

23 -7 8.5 , 

, 2j 10 18.1 

/ 22 8 1^*6 • . . 

S 3^,5 ' . - , . 

THE C0?J BASED aN $ .4 'PER MILE IS $ 1,16 - " 

BUS CAPfelTY 36 T0TAL STUDENTS 3 1 
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I. In what coiimin* and row is the school located? 
column and 



row 



II. 

in. 

V. 



How many students will a type 1 bus carry? 
How many type 1 buses, are .available? 
W&iife-^Ls the average rate of travel? 



How-many grid lines^re f-here t'o a mile? 



VI: What is the cost per, mile to operate the buses? 



Vn. How many minutes does the first; bus take to run its r 
rout^ ? , • ^ 



vm. 



■ ^ - .. < 1. • - 

What is the total cost of 'this bus run? 



The DATA for the school year 1969-70 l3 listed b.elow.. 



Age b 




" Gr 


1 - 


57-2'' 


Gr 


7 - 


618 


Age K 


)- 658 


Gr 


,2'-- 


579 s 


^ Gr 


8 - 


576 


Age 2 


- 708 


' Gr 


3 - 


571 


Gr 


9V 


588 


Age '3 


- 736 


Gr 


4 - 


615 ■ 


Gr] 


632 


Ag4; 4 


-.739 


Gr 


5 - 


584 


- Gr ] 




571 


Kind 


- 763 


■ Gr 


6 -. 


582," 


Gr: 


.2.- 


581 



' Write the DAT 
' simulation •on the 
. "J • ■ •■ 




ements for this data" to b|e used in the ElSfRPRO 
les below. ' 



Study this figur-e and 


then Mswe.r the 


items, below. . ? 








SCHODL DIST 


RICT ■ I 








• 




PAST C£N6ljS A\'D 


FVHOL»,K«:>JT 


DATA / 

/ ; 




AGE OR. 


• 


19^7 






IV 70 


1 g 7 i ■ 






* 


TO 


TO. 


TO 


TO* " 


TO 




GHADE 


• 


1968 




IV 70 


iyv7i 


19 72 * 




GR 1 


• 














GH 2 


• 


650 


" sag 










GR 3 


w 








flu 

' svo 




• 


AGF OR 


m 




IV 7.3 


197^ 










m 




TO 


TD 






• • 




• 




l*,7* 


IV75 


< 177^ 


, 1 JTT 





GR I 
GR 2 



5^0 . 



CO A 

SAO 
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1. The* onroilment in Grade 2 in the '69^^70 school ye^ar is 
II. The projected enrollment in Grade 2 five years later is 



III. The dui'j indicate that thure i.s a(n) trend in the data 

for the projected years. 

a. increasing 

b. .decreasing 

Below is a portion of the year-to-year percent change report. Study it and 
then answer the following items. , ' , 

^AJ7 Cl^Sni AJ*<D tHJnL;.TST 0*1* i** S T» r> TP t G^Avrw-s 

'/^^^i "^^0 !i>„ . : 

«*"5»B ^IS ^IC S6J * ,. 



I. What was the enrollment in ^ade 4 in th^il 968-'69 school year? 
IL What was the enrollment in grade 5 for the same vear':^ 



III. What was the percent ehant;e from 19GS~'69 to 1969-^70 for 
grade J '.^ 

IV. What is the percent change in those group of students who were In 
grade 5 in lOfw-'BS, in the period from 1967-'G>s to 19()S-^G9? 



r3cIo,w is a portion of the comparison report. Studv it and then answer the 
items below*. 











DISTRICT 1 


c 








ACT'JAL VS 




SNRjL^MtlNTS rOR 
i9A7 THPOr»rM 


197S % 
1971 








ACTUAL 
ENROLL 


PHO JECTFD 


ACTUAL ^ 

'*?K)j£CT«:n " 


*« ' 








• ^Ar ^ 










Cft 






S»J2 








GH 


6 


• 67? 


572 


0 


0 
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What was the actual eiiroUment in grade 5? 

Wliat u:u^ the projected enrollment for .i^rade G?- 

\Vhat is the absolute error in prediction for grad 

WTiat is the percent error for grade 5? 



/ 



\ 
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24. Assume that you are in charge of bussing for your district. For one school 
you must decide whether to use one 48 passenger bus or two 24 passenger 
mini-buses. Below is the printout for each of the two cases. Choose one 
of. the following alternatives based on this data. 



CAP AC X TY : 
?24 

CAPAC I TY 2 
70 

VAJJT 72 CHA.VGE ?;VMD£R5 BUSES? YZ3-1, !J2«0 
71 

THE UV:<BtP. 2r 2Xi ?A3SrJ3£~ BUSES 

72 

ENTER THE AVERAGE HAT£ TRAVEL IfJ !^FH 
720 

ENTER THE m'-'mser 27 'J"::3 i.:::E' pep. r.i'^z. 

ran example/ if a g-jarter-*^ile gr:o is used/ e!jter <i 

72 



GJTEft cast 

72.00 



EH MILE T? ;3?ERATE BUSES 



R0UTE I 

STeP STlTSEfiTS 
8 3 
T 10 
6 9 

is 

THE C?ST BASED ?n S ? 
BUS CAPACITY 2a T3TAI 



R0UTE 2 
ST0P 

4 

5 

3 

2 

S 

THE CAST BASEO..?:: S 2 



ST'JDE-VTS 
4 



2 

to 



MiriUTES 
21.6 
29.3 
32.3 

PER "^ILE IS 5 30, 1 : 
ST'JDENTS 22 



MINUTES 
6.2 
16.7 
23. <« 
2a. 9 
23. S 

PEH MIl.E IS S IS. 83 



BUS CAPACITY J>4 



T^TAL STUCErJTS 



ST3PS VHERE -ST^JOE^JTS VERE M3T .^ICKE: 

ST3P st*jde::t5 

I 5 



UP 



C^^lPACITY I 
7A8 

CAPAC I TY 2 
70 

EMTER THE NUMBER 2r Xi3 
71 

ENTER THE AVERAGE T.aTE 3F TRAVEL 
720 

ENTER THE NUMBER Zr GRID LIMES PER MILE. 

F3R EXAMPLE/ IF A QUaRTER-MI LE GRID IS USED* 

72 

ETJTER CaST PER MILE T3 9PERATE B'JSES 
73.00 



PASSEJJGER 3VSES 
IhJ MPH 



EJJTE?. 



/ 



R0UTE 1 

ST0P ' STUDE?J'^S 

1 5 

4 A 

5 A 
8 3 
7 10 

6 9 
3 2 

2 10 
S 

THE C0ST BASED S 3 



^^I!^UTE^ 
3- 

9.2 
19.7 
30.5 * 
38.1 / 
A i . I ./ 
A9 . 9 " 
5 I •X 

P&R riLE IS S 5i.75 



BUS CAPACITY ^8 



rtl'^AL 5^TUDE*JTS 47 



STgpS UHERE STUDENTS /-^EHE ?JC1T PICKED 'JP 
ST0P STUDDJTS / 

WBfJE X 

THE T0-^AL C?3T^Ff!R ALL ROUTES !S S 



THE T0TAL T^rtE r-TR ALL R<T!;TES 
47 STUp€l^JT3 PICKED UP 0 



5-^.8 MINUTES 
r PICKED UP 



THE T3TAL C23T ECR ALL RJUTES 13 S A? - 9 5 
THE T0TAL. TIKE F3R ALL RaVTES 13 7 3-.'^ MOJUTES 
A2 STUDEJJTS PICKED UP 5 N3T PICKED UP 



a: 
b. 
c. 
d. 



/ ' ■ ■ 
Use two smaller^btises because they cost less. 
Use one largej^^us because it takes less cumulative time. 
Use two snKtfler buses because they take less clock time. 
Use one^^rger bus because it picks up all students. 
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B«lo\v are the predictions of enrollment for a junior high school for the 
next five years. W^ich of the conclusions about this data is correct? 

SCHOOL DISTRICT I 

• rUTUHC OlfOLL?<D*T PTOJKCTlCK«S • 

AOr OR • 1972 1973 1974 1975 197A 

• TO TO TO - TO TO • 
^^^l !.!^^^ ^'7' »977 

? • 626 61S 579 594 • 

• 597 636 620 573 • ^ ' 
GR 9 • 666 649 69 1 674 665 

a. Over the next five years space needs will remain the 
same for the seventh grade. 

b. The need for teachers will continue to decline in the • 
8th grade. 

c. The space needs for the 9th grade wiu be fairly consistent 
over the next 5 years. 

d. There should be surplus staff in the 9th gr-ade by 1974. . 
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ID: 



{last 4 digitd of your SS no.) 



Date: 



For each applicable item circle the letter of the 
.best answer. 
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The situation which creates the need for a decision is the: 

a. decision context 

b. perceived need 

c. decl3ion strategj^ 

d. constraints 



List and briefly define the three componer:t.s of the decision context. 
Component 

1 Dfn. 



Dfn. 



Dfn. 



Suppose that you are an assistant superintendent. You have been assigned 
the task oT establishing busing progi-am which will result in racial balance 
within your school system. Your district has allocated $100,000 for busing 
usin^ Its fl,eet of 75 buses. You may adjust the. number of students on any 
bus, the route any bus will follow^ and the sch(. 1 or schools to which it 
delivers. The plan is to b? ready 'to use at the beginning of school fhisjall. 

I. The school or scho to which a bus delivers Is: 



a, none of these 

b. a constraint 

TJ. a percefved need 

d. a controllable variable 



XL To establish a busing prog,ram is 



at, a controllable variable 

b, perceived need 

c, none of these 

d, a constraint 
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in. The 75 buses in the school district fleet represent: 

a. a perceived need 

b. a controllable variable 

c. a, constraint 

d. none of these 



4* The process by which the administrator makes a decision with respect to 
the decision context is the: 

a. perceived need 

b. decision context 

c. analysis of the decision context 

d. decision strategy 

5. The following four activities 

• analysis of the decision context 

• decision on criteria for best solution 

• generation of possible solutions 

• testing of possible solutions against criteria for, best solution 

are components of the 

<^ 

a. decision strategy 

b. controllable variables 

c. decision context 

d. decision variables 



6. The res^ilt or outcome of a specific decision is 

a. a decision context 

b. a payoff '---•^x 

c. what happens 

d. a decision strategy 



7. Suppose that you are responsible for choosing a new reading series for the 

elementary schools in your district. The decision must be made by the spring ^ 
of this year and you have been allocated $25,000. What is the most important ^ 
payoff for this decision? , 

a, reading achievement 

b. total time to prepare 

c, number of texts 

d. * manhours used " \ - - 

. ' ■ : 185 • \. ■;, 1 
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8. Operations Research is 

a. a method for the scientific study of iv.anii-ement or administrative 
functions 

b. a method of research designed to study business operations 

c. a set of powerful decision contexts for larae and complex 
administrative problems 

d. a set x>{ powerful decision strategies for large and :nplex 
J administrative problems 

9- List four important' operations research technique.s and match them with 
administrative applications for which they are must useful (nny operations 
research technique may be applicable to more than one problem). 

^* _planning and analyzing:; project stages 

_____ ^analyzing waiting line problems 

^- . — r analyzing a working model of tHe decision context 

^* _ , ^problems in which the constia'n^'S' and payoff can 

cari be stated matliematically 
problems involving service facilities 




.L8G 



> 



IT S 



10, . is giving the effect or appearance of re ility. 

a, stochastic 
simulation 

c. determtoistlc 

d. role playing 

11, Which of the following is not a component of a simulation? 

a. processes 
' b. object system 

c. ou^uts 

d. model 

12, Name two uses of simulation in education. 



a: 




b. 



13. Which of the following Is not one of the , three classes of simulations? 



a. man^omputer 

b. inan-^model 

c . computc>r-based 

d . mode l-computer 



14. Which of the below Is not a cla£^s,4?t §^ 

a • . • ^ 



a« stochastic 

b. . logarithmic 

c. deterministic 
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15. Which of the followlDg is not r purpose Ox simulat.on? 

a. Tei^oh about thn object system 

b. Replace the object system 

c. Predict fixture behavior of the object system 

d. Explain past behavior of the object system 

16. \Vher. the computer represents all aspects of a simuhuion, i.e., both 
providing input and operating the model, it is a simulation. 

a. man -computer 

b. man-model 

c. computer-based 

d. computer-computer 

17. When some random element is part of a simulation so that random processes 
relate Input to output, the simulation is: 

a. stochastic 

b. deterministic 

c. logarithmic 

18. Assume that you are constructing DATA statements for the BUSRUT simulation 
program. The stop that you are working on now is number 27. It is in 

the 19th row and 33rd column and there are 3 children to pick up. Write 
the proper DATA statement on the line below. 



19. Below is the output from the BUSRUT simulation. Rrid through the listing 
and answer the questions below. j 

THt SCHfU C««IC01t|ATtS* MPkHAJtD BY A CtmiA. 

TJV VJU. 8C ABLC Tf, |MTCJ» TMt CAPACITY tf tJiCM UOIICLt 
rr^C. VMOi KMTeNlMQ, «04C»«^B THAT rut CtHPOTU* VI LL 

1I9UTCS tH THt 0^0 cvTtnta. vnzn tut at a TiMt 

CAPACITY I * 
TtO 

CA^ACfTY .2 • " . 

TO 

PJT» THt HWBtn •r 30 P0kiiV*Otn 8USCS 
WtW TWC-AVCKAdi: XATZ •T TIUVtL IM HPH 

rtm cxArVLto if a ouai!TW*mi 



, - - ..ILC C*!0 IS UStD, tNTU* 4 

WTW CBST Pth HiLt T» tFtlUTC BU5t$ 
.T.8S 

winr I 

ST»^ STU0O4TS HI MUTCS 

H « 4/. I 

10 -5T.« 

TMt C»tT C^Seo »K % »a5 «»CH Htl.C iS » 14. U 

BUS CAPACITY JO T»TaL STUCGMIS J 9 
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In^'hat column and row is the school located? 
column and row . 



' II. How mai^ students will a type 1 bus carxy? ^ 

III. How many type 1 buses are available? 

IV. What is trie average rate of travel? 



V. How many grid lines are there to a mile?_ 



vr. What is the cost per mile to operate the buses? 



VII. How i^any minutes does it take the first bus to run its 
route? 

Vni- What Is the total cost of this bus run?_ ^ 



The data for the school year 1967-'*68 is listed below. 

Age 0 - 686 Gr 1 - 595 Gr 7 - 555 

Age I • ^25 Gr 2 • 650 • Gr 8 569 

Age 2 - r?" Gr 3 - 604 Gr 9 - 589 

Age 3- 774 Gr 4 - 598 Gr 10 - 602 ' 

Age 4 ^ 816 Gr 5 ^ 607 Gr 11 - 540 

Kind - 819. Gr 6 - 5.76 Gr 12 - 470 

Write the DATA statements for this data to be used in the simulation 
ENRPRO on the lines below. 



Below 4s a portion of . the projected ( rrollment report from the prog^i am 
ENHPRO. Study this figure, and answer the following items. 





• 




PAST coasus A.sn 


rNROU'-KPTiT HATA 








AGt OR 


• 

* 
• 


19^7 

TO 
1966, 


TO 

1969 


TO 
r> 70 


\ 19 70 
TO 
1971 


T'l 
1972 




/ 


1 


* 


55S . 






*n7 








r.K 


• 








<<»7 


Mr* 






' 9 ' 












^/i7 












SCHOOL ni STRICT I 








ACE Ofl * 


# 

• 


vm 

TO 
19t3 


TO 


177^ 
T3 




l'>7<' 
I i77 






C/* 7 




'SO? 
















m 












/. . 

/' 

/ 

/ ■ • , 




na 9 . 


# 










*"»7 ' 


1 8< 
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. L The enrollment in Grade 9 Ln 1970-'71 school year is 
II. The projected enrcllment In Grade 9 five years later. i& 



m. The data indicate that there Is a(n) tre:.; in the data 

for the projected years. 

a. decreasing : ' 

b. increasing — 

22. Below is a portion of the • ear-4Q-year comparison report-. Study it and 
answer the following items. 

SCHOOL Dl STRICT I 
PAST C£<StIS ^0 rNfr»LL^rST 0*T* n.fS t» T*l t C-^A^rr^ 

^ CALL otciHAL ricvNfs A»t prKcn^TSi 

• ^ TO <jn tn • « 

''JO _ . 

AO* 666 64» 606 -^66 ^'^2 • ' 

• •* • 

• -».3« -6.32 -3.«t I • 

• ^rt l*3« "^.43 %.«6 • ««lt 

• • 1 
At* 725 6fl6 4)8 441 6ta • 

I. What was the niimber of children at age 0 in 1371 -'72? 



n. 



Wh^ was the number of children at age 1 in the same year? 



in. What was the percent change from 1970-^71 to 1971-'72 for 
a ge 0? 

rv. What was the percent change in t ' ose groups of children who wer^a 
at age 0 in 1969-'70, in the period from 1969-'7i3 to 1970-^71? 



23. Below is a portion of the projected versus actual enrollment report. Study 
It and then answer the items below. 



SCHOOL DISTRICT I \ 

k 





ACTUAL V5 PROJ«:CTED 
BASED OH DATA PrtOM 


EVROLL'M-T^iTS 
19^7 TMROIIPM 


l*7» 
1971 

t 




ACTUAL 


PHOJT.CTKD 


ACTHAL - 

pno^;tCTtp 


< A-P)/A 


KIMO 


• 699 








on X 


« 544 


554 


-10 • 




on a 


• 530 


540 


•1.0 


- 1 • «9 


GR 3 


♦ 532 


539 


•7 
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L What was the actual enrollment in grade 3' 



II. What was the projected enrollment for grade 1? 



in. What is the absolute error in prediction for 'Tirade 1?^ 
TV. What is the percent error for ?rade 2? 



191 
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Assume that you are in. charge of bussing for your (lis;rict. You must decide 
which load factor -(number of students per seat) to u.sc for bussing to 
certain schools. Using BUSRUT tr>' out several different loaci factors. The 
results are given in the table below. 

Load Factor No. of Routes Total Cost Total Time 



1 1/-'^ 
2 

2 1/2 



9 

8 

8 
8 



S '5.26 
■ S3. 50 
74.30 
70.19 



63.5 Ti};.nute3 

77.2 minutes 

79.0 minutes 

•<3.u minutes 



Chooss the best load'factor, consider the data, availai)le. 



a. ; 1/2. 

b. 2 

c. 2 1/2 

d. 3*^= 
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Below is Ibe actual versus predicted enrollniunl repori for a hi^h school. 
How would 5^ou evaluate the accuracy of your predictions? 



SCHOOL DISTRICT 1 



BASCO ON DATA FK-Tri IViS" TWPOM^h W7t 



ACTUAL 



PHOJCCTrn ACTUAL - T rpfnrj 

rvROLi. F=o j?:ct*:d < m- p) / .^ 



0« 427 
U • 570 
G« 12 • 



5 70 



-28 
-^*: 
-7 



-a . 4 7 
- 1 1 . « 
-1 .24 



a. The predictions for grades 10 and 12 are fairly accurate but 
it Ls off for grade 11. 

b. The predictions of enrollment for all the grades are quite 
accurate- 

c. The errors in prediction for all three grades exceed one 
classroom In magnitude. 

d. Only the prediction for grade 12 is accurate. 
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(last 4 digits of your SS no.) 



Date: 



For each applicable Item" circle the letter of the 
best answer.' 

r 
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A decision conterct is: ^ 

a, a choice between two different options 

,b, the adminiistrator's environment 

' c. a problem for which a decision is needed 

d. the school district of the administrator 



List and briefly define the three components gf the decision context. 
Component 
1 Dfn: ^ 



Dfn: 



Dfn: 



^ Suppose that you are a school superintendent. Your school board has just 
adopted the policy that all children should have at least 18 weeks of career 
education by the time they reach the seventh grade. Only , grades 4,5,6 ane 
to be involved and the sum of $50,000 has been allocated. You have the 
freedom to assign any number of teachers for any number of hours and to hire 
as many consultants as necessary provided you do not exceed the authorized 
amount. , ' ^ 

I. The sum of $50, 000 is: - . : 

a. a perceived need - , r 

b. a constraint * ^ * 

c. none of these 

d. a controllable variat 

II. The number of teachers assigned is: 

a. a controllable variable 

b. a perceived need 

c. a constraint 

d. none of these^ 




111. To develop a plan for care.cr education in the upper elementary grades is: 



a, nonh of these 

b, a controllable variable 

c, constraint 

^ d. a perceived need 

r' 

A decision strateg\^ is: 

a. the process by v;hich a decision is made 

b. a problem for which a decision is needed 
the choice between a number of options 

d. the process of implementing a decision 



The four components of a decision strategy are: 



a. 



perceived need, constraints, controllable variables, generation of 



possible solutions C 
cisioQ 



analysis of the decisioi context, . decision on criteria for the best 
solution, perceiving, the apprcpriaU need, testing possible solutions 
against criteria for best solution' . - 

c. analysis of the decision context, decision on criteria for the best 
solution, generation of possible solutions, testing possible solutions 
against criteria for best solution ^ . . 

d. ' finding controlUble variables, decision on criteria for the best 

solution, generation of possible solutions, testing possible^ solutionis 
aga^ifet^criteria for best solution 



A payoff is: _ 

a. the situation which require^ a decision . - 

b, the process of making a decision . ^ 

c. a decision with respect to aj specific context ' 

d, the result of a specific decilion ^ ^ 

Suppose that you have the responsibility for ocmstructing the school district's 
budget for the next fiscal year. You have available to you a full-time secretary, 
ahprevious years' budgets and budget estimates from each of your district's 
schools. The most important payoff of decision making in" this case is: 

,,\' 



C 



a. budget length .. 

b. time 

c. mone^ 

d. line item- costs 
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ts a set of powerful decision strategies for large and 

complex administrative problems . , 



a. opeirations research 

b. linear programming 

c. mathematical modeling 

d. * queueing theory 



List .four important operations research techniques and match, them with 
administrative applications for which they are most useful (Any operations 
research technt6[u6 .may be applicable to more than one problem). 

' 

a. ^ j)lanning and analyzing project' stages 

b. ^ ^analyzing waiting line problems 

c. , ^analyzing a working model of the decision context 

d. ^ p roblems in which the constraints and payoff can 

be stated mathematically . .« 

' p roblems involving service facilities 
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10, which of the following are not basic conditions whic^ must be 
satisfied in order for queuelng theory to give useful results? 

a. . The system must be In equilibrium 

b. There must be at least one customer in the queue 

c. Service times are independent 

d. Customers do not leave the queue until ahey are servi^ced 

e. The arrival and departure rates are independent 
of each other 

f. First come, first served 

g. ^ Arrival rate must be less than the service rate 

h. Arrivals of customers are random and ^ independent 

11. A source field is " . 



a. 
b. 
c. 
d. 



V 

The area where customers of a facility comq from 
The population of customers 

The population of possible service facilities for customers 
The population of potential customers ^ 



12. The users of a service facility are: 



a. Employers 

b. Waiters 
0. Arrivals 
d. Customers 



13. A service/ facility is; 

a. A locationrat-^hich !a service is rendered^ 

b. A buildicig where customers are serviced 

c. The place' where^'the queue is located 

. d. The potential pool of customers for the queue 

* * ' . ■■ 

14. ' The average , number ^of customers arriving at the service facility 

during a' unit of time is the: 

• a.Ue.. \ . 

b. - Departure rate • ; > 

c. Arrival rate ' .^^ * • * 

d. . Customer rate ' * \^ . • 
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'15. The average number of customers that can be serviced by one service* 
facility during a unit of time assuming no idle, time Is the: 

a^ Ai*rival rate 

b. Service r^te 

c. Queue rate 

d. Departure rate 

16. The amount of time that a service facility is not ser\Hcing a austonter 
is the: 

' ' f ' . 

a. Idl^ time 

b. Queueing time 

c. Waiting time 

d. Service time 

17. The waiting time is the time; 

a. between the beginning and ending of service for a customer 

b. that a customer spends in the source field before he joins the. 
queue 

c. the total time that a customer spends in the queue and service 
facility 

d. between when .the customer joins the queue and when he gets 
serviced 

18. Which of the statistics listed below/are not statistics derived from - 
• , queueing theory? . , 

a. expected waiting time of an arrival 

b. expepted mmiber of custQmers waiting for service or being 
serviced f . ^ 

c. pro^bal^ility that a customer will .be . serviced within -t>ime T 

d. es?)ected number of customers waiting for service * ^ 

e. probability that the facility is idle ^ ^ . 

f. mean number of custonlers being serviced : 

g. probability that N^users are being serviced or are waiting for 
service . .. ' • 

h. pr<ibaJft}ity^that/m.ore than L users ar^ being serviced or are- 
waiting \ 
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19. As the number of service facilities increases, the length of the queue 

the waiting time^ ' and the probability of a 

service facility being idle . 



a. decreases, increases, decreases 

b. decreases, decreases, increases 

c. increases, decreases, decreases 

d. increases, increases. Increases 

20. As the arrival rate decreases, the length of the queue_; 

the waiting time , and the probabQity of the service facility 

being idle . . 

a. decreases t decreases,' increases 

b. Increaaefe, decreases, decreases 

c. Increases, Increases, Increases 

d. (Jecreases, Increases, decreases 

21. As the service rate decreases, the length of the queue 



the waiting tlme_ , and the probabQity of the service 

facility being idle . 

a. decreases, decreases, increases 

b. increases. Increases, increases^ 

c. increases. Increases, decreases 

d. increases, decreases, decreases 

Your local h^lgh school has' a printshop for vocational education. They 
do large printing jobs for the school district. The Instructor has made 
a request for a second printing press. He claims that ^the class cannot 
-keep up with the number of requests they 'receive. The shop receives 
an average of three orders each week. It takes an average of one and 
one-half days to complete a job. 

Answer the follow questions about this queueing theory problem.^ 



I. The source field is^ 
n. The cus.tomer's are 



in. The service facility Is^ 

>• 

•^JV. The arrival rate is 
V. The service rate ^ 
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Below Is the output of prograin QUEUE for :i queueuig theor}- problem. 
U^e chis to answer -the questions below. 



ENTEH S0URCE TI ELD 

O-lNriNlTE P0PyLATl0M 

K - FINITE P3PULA;:3!i ST S:ZZ M 

- I TO Ob IT 

?0 

r - NUMBER 0r SERVICE FACILlTlrlS 
72 

A - AVERAGE SF AP.HIVALS PER ^-TJIT TIM*: 

?!2 , , 

S - AVEPJVCE rvLT^IBER OP CL'STSKt^.S S£?»-VH:d PER LTJIT TIME 
78 

PRaSABIl.ITY THAT THE FACILITY IS IDLE - P(0) • .1^2657 

EXPECTED NUMBER EITHER BEING TE^VICED eH VAITIN'O - ECW) • 3 . 57 

EXPECTED N'JftSER WAITING - ECV) » 1.926 57 

55CPECTED VAlTlrJG TI^je PF Afi Ar.'llVAL - ECT) = .!607lft 

IF YBU UlSH PC?0* THE PPaDAElLITY THAT tl U: _ .5 ARE BEirJG 

SERVICED 0=1 UAITIHG-* E:JT£H THE ML^ISER FZR U. JF N2IT, 

ENTER -I ' 

75 

PC 5 }« 6.7g0i3E-02 

ENTER ANeTMER N -1 TO GUIT 
•> - I 

IF YaU VISH PC:J>5-)# the PRBDABILITY that THE NWBER 0F 

USERS BEING SERVICED 0P. '-'AITlrJG EXCEEDS SSflE NUMBER L* 
ENTER THE NUMBER F0R L. IF H0T, SNTER -1 

73 

pCH> 3 > « .290179 

ENTER AN0THER L 0R -1 T9 CUl T ' 
7-1 



I. The probability, that the number waiting and being serviced 
is greater than 3 Is ^ 



n. Average number cf arrivals is 



m. The number of service facilities is 



IV. The probability that the facility is idle is 



V. The probability that five customers are waiting or being 
serviced is . « 



VI. Average, number of customers being si?rviced is 



Vn. The expepted nimiber waiting is ^ 



Vni. How long should an arrival expect to wait? 



DC. "^^liat is the expected number in 4±ie queue or being serviced? 



X.. The average service rate is 



2 (>1 • 
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In Item 23 you were given a printout which reflects the following 
queuelng theory problem. An office- presently has two typists. 
They are contemplating adding a third typist. Using the printout from 
item 23 plus the one -given below, you must decide whether. or not 
to hire an extra secretary. The time unit is days. 

A poll of users has shown that they will not tolerate a wait of more 
than 1 day. 

D<7ER SeUHCE FIELD 

O-INFINtTE POPULATIBf' 
M - FINITE >^0FULATION 0F SHE M 
-I T9 QUIT 

70 

r - NUK3EH 0F SERVICE FACILITIES 
73 

A - AVERAGE NUJlBEF 0F ARRIVALS PER 'JrilT TIME 
TJ 2 

s - a;;erage number sf customers served per '^'^it .i^c. 
7a 

'pneBABILlTY THAT THE FACILITY IS J.DLEy- PCO) - .21CS£6 
EXPECTED MUKBER EITH:R 9E1»G LmviCZD^H VAITING - ECN) - 1.7J6BA 
DCPECTED nrJMBER VAlTING - EfV; - .2 3.63^2 

EXPECTED VAITING TIME tfF Mi ARRIVAL - E< T) 1 - '5 7 3 6B E-G ^ 

■ 

a. Hire one, because the average number waiting or being 
serviced will be reduced to less than the number of 
secretaries. ^ u 

b. Do uot hire one because the expected waiting time is only 
reduced from 1/3 to l/lOO of a day. 

c. Hire. one because the average number waiting will be reduced 
more 'than 80%. 

d. Do not hire one, because each typist \yill then be idle more than 
1/5 of the time. 

f 

25. Which of the following Is/are not advantage(s) of queue inr" theory? 
/ 

a. Provides a method for simulating changes in the queuelng 
system aad observing the results. 

b. Provides criteria for determmlng the ''best'' solution to a problem. 
G> Provides a means for analyzing most problems which involve 

waiting In llnejs!,^ 
d. Provides data which may suggest possible changes in the 

queuelng system. . 
e^ Provides a framework for studying the queueing system. 
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26. WTilch of the foUowLng is/ are not disadvantages of queue Lng theory? 

a. The results from queueing theory are averages, not 
exact results. 

b. Problems must satisfy certain condi^ons in order to be 
analyzed using queueing theory, 

c. Queueing theory is vei^^ limited when dealing with small 
populations. 

d. Queueing theory yields data and does not make decisions. 

e. The results of a queueing theory analysis are too abstract 
and difficult to undersi'and. 



J 
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ID. 



isst 4 digits of 55». 



?elo .«. 3:-o n >t r:t's of 'rjcst : )ns ; :;:t?rr.:-u s» ir'itifio .'nanaj^em*- techniqu8S, 
Si:rTje </' tht-s*.* i' -r^i s >'j rr. t • .n-rcv :h jn<i -a ii h o!b*'. s you may not 
a-j^ret^. Plens** .r.ii.:ite >0'jr deivM t* .•'••emt-nt by c». cling SA (Strongly 

A<ree>, A 4A^rvrt, \' ..\%?u:rari, 1 1 us-i t e», or SD (Strongly Disagree) 
for eath itt-rr.. yju are nof pr'^t^';tiy -n ao::iip.'.strator, please assume an 
m;rii>f rator s r-;irt of v.e'^' •Aht'D roriponfnng to the items. 

1. N!2:ht'nn*;v< :s ^ ^h^:'.'! .l :r; ; r t r^t ;■. <• t SA A N D SD 

2. There aro a n-^-r.^er ^^'icr.UU.^ p;a:..ij:etr.L-':: 

methods for su'virs; aciministra'ive pr^'Me.Tis „^ 

m odccaiKn. SA A N D 5D " 

3. I find mathematics useful id rr.v work ss an 

educational aoministrstor. SA A N D SD 

4. 1 know of lenst four sv'.^n'vrc rnnn:rceme:it 

; ei.hr!iqu(iii fcr solviri}; nrimtn;si !-nt;vo : rjble:;i:5 

in ed'.ication. SA A N D SD 

5. Few of the problems 1 encount-.r in jf,- wmtk 

ran be solved by scicmfific rri:in3eemf"t mef^ods, SA A N D SD 

6. I will use scientific management techti cues for 

solving many of the problems my v;o^k. SA A N D SD 

7. I 'know of at least one scient ific man.acmL*nt 
technique for soK in? admims'. r;:ti ve f" 0)lems 

in education. SA AND SD 

I plan to seloom use sciec.^.iffC mana'^Msi ent mc-hods 

in .solving the problems I ^intnimter in my ^AMrk. S.A AND SD 

J. 1 foel comfortable usini; sf^^enttfic m.Jni;cmcrit 

techniques in my work. SA A N D SD 

10. I want to use scientific m.ara^ement t '".''iniqc^tf; ;n 

m.v work. SA A N D SD 



Below are some questions concerning the ?ijfiteri;ils you studied. Please respond 
ns you did to the [?reviou5 info r mat on. 



11. 


The problem solving technique that I ilciied vill be 
very useful in solvinj^ educational adnvmslrative 
problems. 


SA 


A 


N 


D 


SD 


12. 


The materials I studied were t;:»sy to un iersi.ind. 


SA 




N 


D 


SD 


13. 


Using the computer made these m:iteri'il> mere 
interesting. 


SA 


A 


N 


D 


SD 


14. 


I ned eno'jj;h from Ihesn materials v use 
Ihenuin my work as an administrator. 


SA 


A 




I' 


SD 


15. 


I will not use the techmcue I studied ig my 
work as an administrator. 


SA 


A 


N 


D 


SD 


16. 


I am generally s.i'.isfied with «ho materials I 
studied. 


SA 


A 


N 


D 


SD 


17. 


More direction from the instr'jctor was r.eclrd. 


SA 


A 


N 


D 


SD 


16. 


The computer is an essential part of th? .o rraterials. 


SA 


A 


N 


D 


SD 
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Materi^ils Used: 



VVTiat is your positit 
WTaat degree do you hold? 



ID. 



Last 4 digits of SS# 
Date: 



How many years of administrative experience have you had? 
How many hours did you spend on the maierials? ^ 



Did you work by yourself or with a t;,roup? Do you prefer that way? 



Did you have enough time to finish the unit? If you did not, why not? 



Did you have any difficulties using the computer? 



205 



8. What was the best thing about these matertals? 



7 



9. What was the v/orst thing about these n^aterials? 
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10. What could be improved in the booklet you just read? 



11. Do you have any specific criticisms of the materials? 



12. Please state the difficulty of the materials from your point of view.^ 
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13. Wo.uld you recommend to others the materials you studied? Why or Why* • 
not? * ^ 



14. Please summarize your overall feeling- abofut the materials. 
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